LLM Name | Mistral Small 24B Instruct 2501 Bf16 |
Repository ๐ค | https://huggingface.co/mlx-community/Mistral-Small-24B-Instruct-2501-bf16 |
Base Model(s) | |
Model Size | 24b |
Required VRAM | 46.9 GB |
Updated | 2025-06-09 |
Maintainer | mlx-community |
Model Type | mistral |
Instruction-Based | Yes |
Model Files | |
Supported Languages | en fr de es it pt zh ja ru ko |
Model Architecture | MistralForCausalLM |
License | apache-2.0 |
Context Length | 32768 |
Model Max Length | 32768 |
Transformers Version | 4.49.0.dev0 |
Tokenizer Class | LlamaTokenizer |
Vocabulary Size | 131072 |
Torch Data Type | bfloat16 |
Best Alternatives |
Context / RAM |
Downloads |
Likes |
---|---|---|---|
...ral Nemo Instruct 24B Merge V1 | 1000K / 24.6 GB | 9 | 0 |
Cydonia 24B V3 | 128K / 47.3 GB | 418 | 23 |
Harbinger 24B | 128K / 47.3 GB | 357 | 55 |
Pantheon RP 1.8 24B Small 3.1 | 128K / 47.3 GB | 1417 | 63 |
...Small 3.1 24B Instruct 2503 HF | 128K / 47.3 GB | 1780 | 12 |
...Small 3.1 24B Instruct 2503 Hf | 128K / 47.3 GB | 1087 | 2 |
Zero Mistral 24B | 128K / 47.3 GB | 437 | 5 |
Eurydice 24B V3 | 128K / 47.3 GB | 183 | 6 |
Mistral Small 3.1 24B RP | 128K / 47.3 GB | 12 | 0 |
... 24B Small Instruct Ties Merge | 128K / 47.3 GB | 198 | 3 |
๐ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐