LLM Name | Open Hermes 2.5 Neural Chat 3.1 Frankenmerge 11B Gguf Q8 |
Repository ๐ค | https://huggingface.co/S4sch/Open-Hermes-2.5-neural-chat-3.1-frankenmerge-11b-gguf-q8 |
Base Model(s) | |
Model Size | 11b |
Required VRAM | 8.3 GB |
Updated | 2025-07-31 |
Maintainer | S4sch |
Model Type | mistral |
Model Files | |
GGUF Quantization | Yes |
Quantization Type | gguf|q8|q5_k |
Model Architecture | MistralForCausalLM |
License | apache-2.0 |
Context Length | 32768 |
Model Max Length | 32768 |
Transformers Version | 4.35.2 |
Vocabulary Size | 32002 |
Torch Data Type | bfloat16 |
Best Alternatives |
Context / RAM |
Downloads |
Likes |
---|---|---|---|
Normistral 11B Warm | 1000K / 22.9 GB | 143 | 8 |
Huginn V5.10.7B | 32K / 21.4 GB | 0 | 0 |
... 11B V2.2 Instruct EXL2 4.5bit | 32K / 6.5 GB | 60 | 3 |
...B V2.2 Instruct HQQ 4bit 128gs | 32K / 6.2 GB | 18 | 3 |
...B V2.2 Instruct HQQ 8bit 128gs | 32K / 11.7 GB | 15 | 3 |
Bielik 11B V2.2 Instruct FP8 | 32K / 11.4 GB | 230 | 3 |
Bielik 11B V2.2 Instruct GPTQ | 32K / 6.2 GB | 200 | 3 |
... 11B V2.2 Instruct Quanto 8bit | 32K / 12 GB | 41 | 4 |
Bielik 11B V2.2 Instruct AWQ | 32K / 6.2 GB | 33 | 3 |
Bielik 11B V2.2 Instruct W8A8 | 32K / 11.5 GB | 15 | 3 |
๐ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐