LLM EXPLORER 63,407 MODELS INDEXED

TheDrummer Moistral 11B V2 HQQ 4bit Smashed by PrunaAI

By PrunaAI · 5 downloads

TheDrummer Moistral 11B V2 HQQ 4bit Smashed is an open-source language model by PrunaAI. Features: 11b LLM, VRAM: 6GB, Context: 8K, Quantized, LLM Explorer Score: 0.13.

  4bit Base model:beaverlegacy/moistr... Base model:finetune:beaverlega...   Llama   Pruna-ai   Quantized   Region:us

TheDrummer Moistral 11B V2 HQQ 4bit Smashed Parameters and Internals

Additional Notes 
Check 'smash_config.json' for configuration info.
LLM NameTheDrummer Moistral 11B V2 HQQ 4bit Smashed
Repository πŸ€—https://huggingface.co/PrunaAI/TheDrummer-Moistral-11B-v2-HQQ-4bit-smashed 
Base Model(s)  Moistral 11B V2   TheDrummer/Moistral-11B-v2
Model Size11b
Required VRAM6 GB
Updated2025-09-23
MaintainerPrunaAI
Model Typellama
Model Files  6.0 GB
Quantization Type4bit
Model ArchitectureLlamaForCausalLM
Context Length8192
Model Max Length8192
Transformers Version4.40.0
Tokenizer ClassLlamaTokenizer
Padding Token</s>
Vocabulary Size32000
Torch Data Typefloat16

Best Alternatives to TheDrummer Moistral 11B V2 HQQ 4bit Smashed

Best Alternatives
Context / RAM
Downloads
Likes
... 11B V2.5 Instruct FP8 Dynamic32K / 11.5 GB332
...istral 11B Omni OPA U1k Ver0.732K / 21.4 GB120
Mistral 11B OP U1k Ver0.732K / 21.4 GB120
Mistral 11B Omni OP U1k Ver0.532K / 21.4 GB190
...mbulvetr 11B V2.8.0bpw H8 EXL24K / 10.9 GB67
...mbulvetr 11B V2.6.0bpw H6 EXL24K / 8.2 GB34
...mbulvetr 11B V2.3.0bpw H6 EXL24K / 4.3 GB61
...mbulvetr 11B V2.4.0bpw H6 EXL24K / 5.6 GB50
Solstice 11B V1.8.0bpw H8 EXL24K / 10.9 GB90
A6.11024K / 16.1 GB1300
Note: green Score (e.g. "73.2") means that the model is better than PrunaAI/TheDrummer-Moistral-11B-v2-HQQ-4bit-smashed.