LLM Name | Dolphin Mistral 24B Venice Fp16 |
Repository ๐ค | https://huggingface.co/root4k/Dolphin-Mistral-24B-Venice-fp16 |
Base Model(s) | |
Model Size | 24b |
Required VRAM | 46.9 GB |
Updated | 2025-07-31 |
Maintainer | root4k |
Model Type | mistral |
Model Files | |
Quantization Type | fp16 |
Model Architecture | MistralForCausalLM |
License | apache-2.0 |
Context Length | 32768 |
Model Max Length | 32768 |
Transformers Version | 4.51.0.dev0 |
Tokenizer Class | LlamaTokenizerFast |
Padding Token | <pad> |
Vocabulary Size | 131072 |
Torch Data Type | bfloat16 |
Best Alternatives |
Context / RAM |
Downloads |
Likes |
---|---|---|---|
...al Small 2507 Unsloth Bnb 4bit | 128K / 15 GB | 11870 | 4 |
...al Small 2506 Unsloth Bnb 4bit | 40K / 15 GB | 3021 | 4 |
Napoleon 24B V0.0 | 32K / 47.3 GB | 193 | 0 |
Not So Small Alpaca 24B | 32K / 47.3 GB | 6 | 0 |
...Instruct 2501 Unsloth Bnb 4bit | 32K / 15 GB | 19687 | 17 |
...24B Base 2501 Unsloth Bnb 4bit | 32K / 15.7 GB | 1390 | 3 |
...all 24B Instruct 2501 Bnb 4bit | 32K / 14.2 GB | 533 | 3 |
...l Small 24B Base 2501 Bnb 4bit | 32K / 14.2 GB | 242 | 2 |
...b With Nemotron Converted Vllm | 32K / 47.3 GB | 38 | 0 |
Dolphin3.0 R1 Mistral 24B 4bit | 32K / 13.3 GB | 95 | 2 |
๐ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐