LLM EXPLORER 59,420 MODELS INDEXED

Fimbulvetr 11B V2 AWQ by LoneStriker

By LoneStriker · 5 downloads

Fimbulvetr 11B V2 AWQ is an open-source language model by LoneStriker. Features: 11b LLM, VRAM: 6GB, Context: 4K, License: cc-by-nc-4.0, Quantized, LLM Explorer Score: 0.12, Arc: 70.1, HellaSwag: 87.8, MMLU: 66.7, GSM8K: 63.7.

  4-bit   Awq   En   Endpoints compatible   Llama   Quantized   Region:us   Safetensors   Sharded   Tensorflow

Fimbulvetr 11B V2 AWQ Parameters and Internals

Additional Notes 
This description contains informal context about personal musings and challenges from the developer.
Supported Languages 
en (unknown)
Input Output 
Input Format:
Alpaca or Vicuna
Release Notes 
Version:
15/2
Notes:
Suitable for Release. Model focused on the submission for the Chai app. Scaling results to Yi/Mixtral soon.
LLM NameFimbulvetr 11B V2 AWQ
Repository πŸ€—https://huggingface.co/LoneStriker/Fimbulvetr-11B-v2-AWQ 
Base Model(s)  Fimbulvetr 11B V2   Sao10K/Fimbulvetr-11B-v2
Model Size11b
Required VRAM6 GB
Updated2026-08-07
MaintainerLoneStriker
Model Typellama
Model Files  5.0 GB: 1-of-2   1.0 GB: 2-of-2
Supported Languagesen
AWQ QuantizationYes
Quantization Typeawq
Model ArchitectureLlamaForCausalLM
Licensecc-by-nc-4.0
Context Length4096
Model Max Length4096
Transformers Version4.37.1
Tokenizer ClassLlamaTokenizer
Vocabulary Size32000
Torch Data Typefloat16

Best Alternatives to Fimbulvetr 11B V2 AWQ

Best Alternatives
Context / RAM
Downloads
Likes
Synthia V3.0 11B AWQ4K / 6 GB52732
Tengentoppa 11B Instruct AWQ2K / 6.8 GB60
... 11B V2.5 Instruct FP8 Dynamic32K / 11.5 GB332
...istral 11B Omni OPA U1k Ver0.732K / 21.4 GB120
Mistral 11B OP U1k Ver0.732K / 21.4 GB120
Mistral 11B Omni OP U1k Ver0.532K / 21.4 GB190
...istral 11B V2 HQQ 4bit Smashed8K / 6 GB50
...mbulvetr 11B V2.8.0bpw H8 EXL24K / 10.9 GB67
...mbulvetr 11B V2.6.0bpw H6 EXL24K / 8.2 GB34
...mbulvetr 11B V2.3.0bpw H6 EXL24K / 4.3 GB61
Note: green Score (e.g. "73.2") means that the model is better than LoneStriker/Fimbulvetr-11B-v2-AWQ.