MelloGPT GGUF by TheBloke

 ยป  All LLMs  ยป  TheBloke  ยป  MelloGPT GGUF   URL Share it on

MelloGPT GGUF is an open-source language model by TheBloke. Features: LLM, VRAM: 3.1GB, License: mit, Quantized, LLM Explorer Score: 0.11.

Base model:quantized:steve-cse...   Base model:steve-cse/mellogpt   Conversational Dataset:nbertagnolli/counsel-c...   Gguf   Mistral   Quantized   Region:us
Model Card on HF ๐Ÿค—: https://huggingface.co/TheBloke/MelloGPT-GGUF 

MelloGPT GGUF Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
MelloGPT GGUF (TheBloke/MelloGPT-GGUF)
๐ŸŒŸ Advertise your project ๐Ÿš€

MelloGPT GGUF Parameters and Internals

Model Type 
mistral
Additional Notes 
A fine-tuned version of Mistral-7B-v0.1 specifically designed for mental health conversations, utilizing a dataset of counseling sessions.
Training Details 
Data Sources:
nbertagnolli/counsel-chat
Methodology:
fine-tuning
LLM NameMelloGPT GGUF
Repository ๐Ÿค—https://huggingface.co/TheBloke/MelloGPT-GGUF 
Model NameMelloGPT
Model CreatorSteve Boby George
Base Model(s)  MelloGPT   steve-cse/MelloGPT
Required VRAM3.1 GB
Updated2026-03-19
MaintainerTheBloke
Model Typemistral
Model Files  3.1 GB   3.8 GB   3.5 GB   3.2 GB   4.1 GB   4.4 GB   4.1 GB   5.0 GB   5.1 GB   5.0 GB   5.9 GB   7.7 GB
GGUF QuantizationYes
Quantization Typegguf
Model ArchitectureAutoModel
Licensemit

Best Alternatives to MelloGPT GGUF

Best Alternatives
Context / RAM
Downloads
Likes
ComicBot V.2 Gguf32K / 5 GB370
Qwen3 Medical GRPO GGUF0K / 1.7 GB1076
...ixtral 8x7B Instruct V0.1 GGUF0K / 15.6 GB17405655
Gemma2 WizardLM0K / 5.2 GB100
Phi 2 GGUF0K / 1.2 GB20535232
Marco O1 GGUF0K / 3 GB746
Dolphin 2.5 Mixtral 8x7b GGUF0K / 15.6 GB12299303
Mixtral 8x7B V0.1 GGUF0K / 15.6 GB4245436
Dolphin 2.7 Mixtral 8x7b GGUF0K / 15.6 GB9237147
GOAT Llama3.1 V0.10K / 0.2 GB173
Note: green Score (e.g. "73.2") means that the model is better than TheBloke/MelloGPT-GGUF.

Rank the MelloGPT GGUF Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 52509 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Check out Ag3ntum โ€” our secure, self-hosted AI agent for server management.
Release v20260328a