LLM EXPLORER 66,704 MODELS INDEXED

DeepSeek V4.1 Flash MixedQ2 GGUF by apetersson

By apetersson · 6802 downloads
HF Repo ↗ Copy URL

DeepSeek V4.1 Flash MixedQ2 GGUF is an open-source language model by apetersson. Features: LLM, VRAM: 10.8GB, License: mit, Quantized, LLM Explorer Score: 0.32.

Base model:deepseek-ai/deepsee... Base model:quantized:deepseek-...   Deepseek   Deepseek-v4.1   Deepseek v41   Endpoints compatible   Fp8   Gguf   Iq2-xxs   Mixed-quant   Q2   Q2-k   Quantized   Region:us
Model Card on HF 🤗: https://huggingface.co/apetersson/DeepSeek-V4.1-Flash-MixedQ2-GGUF 

DeepSeek V4.1 Flash MixedQ2 GGUF Parameters and Internals

LLM NameDeepSeek V4.1 Flash MixedQ2 GGUF
Repository 🤗https://huggingface.co/apetersson/DeepSeek-V4.1-Flash-MixedQ2-GGUF 
Base Model(s)  deepseek-ai/DeepSeek-V4.1-Flash   deepseek-ai/DeepSeek-V4.1-Flash
Required VRAM10.8 GB
Updated2026-09-13
Maintainerapetersson
Model Typedeepseek_v41
Model Files  39.2 GB: 1-of-5   40.0 GB: 2-of-5   39.0 GB: 3-of-5   40.0 GB: 4-of-5   10.8 GB: 5-of-5
GGUF QuantizationYes
Quantization Typegguf|q2
Model ArchitectureDeepseekV41ForCausalLM
Licensemit
Model Max Length1048576
Transformers Version5.6.0
Tokenizer ClassPreTrainedTokenizerFast
Beginning of Sentence Token<｜begin▁of▁sentence｜>
End of Sentence Token<｜end▁of▁sentence｜>

Best Alternatives to DeepSeek V4.1 Flash MixedQ2 GGUF

Best Alternatives
Context / RAM
Downloads
Likes
DeepSeek V4.1 Flash 1017 MLXse0K / 11 GB7872
...ek V4.1 Flash 1017 EXL3 2.7bpw0K / 2.3 GB5355
DeepSeek V4.1 Flash Spark0K / 18.5 GB5587
DeepSeek V4.1 MLX Q4i0K / 144.9 GB20541
...sh 1017 EXL3 2.75bpw DGX Spark0K / 2.3 GB2112
...ek V4.1 Flash 1017 EXL3 2.7bpw0K / 2.3 GB1461
...k V4.1 Flash 1017 EXL3 2.87bpw0K / 2.3 GB651
DeepSeek V4.1 Flash Genesis0K / 377.8 GB1504
....75bpw LegalWeighted DGX Spark0K / 2.3 GB351
DeepSeek V4.1 Flash REAP 256E0K / 206.2 GB1046
Note: green Score (e.g. "73.2") means that the model is better than apetersson/DeepSeek-V4.1-Flash-MixedQ2-GGUF.