LLM EXPLORER 60,645 MODELS INDEXED

Air Striker Mixtral 8x7B ZLoss 3.75bpw H6 EXL2 by LoneStriker

By LoneStriker · 8 downloads

Air Striker Mixtral 8x7B ZLoss 3.75bpw H6 EXL2 is an open-source language model by LoneStriker. Features: LLM, VRAM: 22.2GB, License: apache-2.0, MoE, Quantized, LLM Explorer Score: 0.1.

  4-bit   Bitsandbytes Dataset:jondurbin/airoboros-3....   En   Exl2   Lora   Mixtral   Moe   Quantized   Region:us   Safetensors   Sharded   Tensorflow

Air Striker Mixtral 8x7B ZLoss 3.75bpw H6 EXL2 Parameters and Internals

Additional Notes 
Experimental model, trained using config and Transformers/Axolotl forks provided by Doctor-Shotgun.
Training Details 
Data Sources:
jondurbin/airoboros-3.2
Methodology:
Fine-tuning
Context Length:
8000
LLM NameAir Striker Mixtral 8x7B ZLoss 3.75bpw H6 EXL2
Repository πŸ€—https://huggingface.co/LoneStriker/Air-Striker-Mixtral-8x7B-ZLoss-3.75bpw-h6-exl2 
Required VRAM22.2 GB
Updated2026-08-08
MaintainerLoneStriker
Model Files  8.6 GB: 1-of-3   8.6 GB: 2-of-3   5.0 GB: 3-of-3
Supported Languagesen
Quantization Typeexl2
Model ArchitectureAutoModelForCausalLM
Licenseapache-2.0
Is Biasednone
Tokenizer ClassLlamaTokenizer
PEFT TypeLORA
LoRA ModelYes
PEFT Target Modulesq_proj|w1|v_proj|gate|o_proj|w3|k_proj|w2
LoRA Alpha16
LoRA Dropout0.07
R Param64

Best Alternatives to Air Striker Mixtral 8x7B ZLoss 3.75bpw H6 EXL2

Best Alternatives
Context / RAM
Downloads
Likes
Mistral0K / 0.2 GB180
...emo Instruct 2407 EXL2 8bpw H80K / 12.6 GB77
Dre Phi0K / 7.6 GB70
Phi 3 Mini 4K CodeInstruct0K / 7.6 GB100
...3 Mini 4K Instruct Text To Sql0K / 7.6 GB120
MS32 30K / 1.5 GB50
Asdf0K / 0.1 GB160
MS32 20K / 0.7 GB50
...ve Radiology Report Generation0K / 0.2 GB9584415
Phi 3 Mini 4K Python0K / 7.6 GB6321
Note: green Score (e.g. "73.2") means that the model is better than LoneStriker/Air-Striker-Mixtral-8x7B-ZLoss-3.75bpw-h6-exl2.