LLM Name | Mistral 11B OmniMix Bf16 |
Repository ๐ค | https://huggingface.co/NeverSleep/Mistral-11B-OmniMix-bf16 |
Model Size | 11b |
Required VRAM | 21.5 GB |
Updated | 2025-08-20 |
Maintainer | NeverSleep |
Model Type | mistral |
Model Files | |
Model Architecture | MistralForCausalLM |
License | cc-by-nc-4.0 |
Context Length | 32768 |
Model Max Length | 32768 |
Transformers Version | 4.35.0.dev0 |
Tokenizer Class | LlamaTokenizer |
Vocabulary Size | 32000 |
Torch Data Type | bfloat16 |
Model |
Likes |
Downloads |
VRAM |
---|---|---|---|
Mistral 11B OmniMix GGUF | 14 | 171 | 4 GB |
Mistral 11B OmniMix GPTQ | 2 | 7 | 6 GB |
Mistral 11B OmniMix AWQ | 2 | 7 | 6 GB |
Best Alternatives |
Context / RAM |
Downloads |
Likes |
---|---|---|---|
Starling LM 11B Alpha | 32K / 21.4 GB | 752 | 15 |
...elik V2.3 Instruct MedIT Merge | 32K / 22.3 GB | 110 | 2 |
ConfigurableBeagle 11B | 32K / 21.4 GB | 8064 | 3 |
CarbonBeagle 11B Truthy | 32K / 21.4 GB | 11551 | 10 |
CarbonBeagle 11B | 32K / 21.4 GB | 8417 | 9 |
...elik V2.3 Instruct Llama Prune | 32K / 15.4 GB | 5 | 0 |
MistralLite 11B | 32K / 21.4 GB | 1337 | 2 |
Mistral 11B Miniplatypus | 32K / 21.5 GB | 5 | 0 |
Mistral Evolved 11B V0.1 | 32K / 22.3 GB | 58 | 33 |
Mistral 11B Instruct V0.1 | 32K / 42.9 GB | 5 | 0 |
๐ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐