LLM Name | Dolphin3.0 R1 Mistral 24B 4bit |
Repository ๐ค | https://huggingface.co/mlx-community/Dolphin3.0-R1-Mistral-24B-4bit |
Base Model(s) | |
Model Size | 24b |
Required VRAM | 13.3 GB |
Updated | 2025-06-11 |
Maintainer | mlx-community |
Model Type | mistral |
Model Files | |
Supported Languages | en |
Quantization Type | 4bit |
Model Architecture | MistralForCausalLM |
Context Length | 32768 |
Model Max Length | 32768 |
Transformers Version | 4.48.1 |
Tokenizer Class | LlamaTokenizer |
Padding Token | <pad> |
Vocabulary Size | 131074 |
Torch Data Type | bfloat16 |
Best Alternatives |
Context / RAM |
Downloads |
Likes |
---|---|---|---|
...Instruct 2501 Unsloth Bnb 4bit | 32K / 15 GB | 54799 | 17 |
Not So Small Alpaca 24B | 32K / 47.3 GB | 18 | 0 |
Napoleon 24B V0.0 | 32K / 47.3 GB | 16 | 0 |
...24B Base 2501 Unsloth Bnb 4bit | 32K / 15.7 GB | 1773 | 3 |
...l Small 24B Base 2501 Bnb 4bit | 32K / 14.2 GB | 1067 | 2 |
...all 24B Instruct 2501 Bnb 4bit | 32K / 14.2 GB | 710 | 3 |
...b With Nemotron Converted Vllm | 32K / 47.3 GB | 38 | 0 |
... 24B Base ChatML 2501 Bnb 4bit | 32K / 14.2 GB | 11 | 2 |
...ral Small 24B New Params 16bit | 32K / 47.3 GB | 5 | 0 |
...all3 24B InstructContinuedFine | 32K / 47.3 GB | 13 | 0 |
๐ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐