LLM EXPLORER 67,808 MODELS INDEXED

DeepSeek R1 Distill Qwen 7B Unsloth Bnb 4bit by unsloth

By unsloth · 5662 downloads

DeepSeek R1 Distill Qwen 7B Unsloth Bnb 4bit is an open-source language model by unsloth. Features: 7b LLM, VRAM: 8.5GB, Context: 128K, License: apache-2.0, Quantized, LLM Explorer Score: 0.19.

  4-bit   4bit Base model:deepseek-ai/deepsee... Base model:quantized:deepseek-...   Bitsandbytes   Conversational   Deepseek   En   Endpoints compatible   Quantized   Qwen   Qwen2   Region:us   Safetensors   Sharded   Tensorflow   Unsloth

DeepSeek R1 Distill Qwen 7B Unsloth Bnb 4bit Parameters and Internals

LLM NameDeepSeek R1 Distill Qwen 7B Unsloth Bnb 4bit
Repository πŸ€—https://huggingface.co/unsloth/DeepSeek-R1-Distill-Qwen-7B-unsloth-bnb-4bit 
Base Model(s)  DeepSeek R1 Distill Qwen 7B   deepseek-ai/DeepSeek-R1-Distill-Qwen-7B
Model Size7b
Required VRAM8.5 GB
Updated2026-08-02
Maintainerunsloth
Model Typeqwen2
Model Files  5.0 GB: 1-of-2   3.5 GB: 2-of-2
Supported Languagesen
Quantization Type4bit
Model ArchitectureQwen2ForCausalLM
Licenseapache-2.0
Context Length131072
Model Max Length131072
Transformers Version4.49.0.dev0
Tokenizer ClassLlamaTokenizerFast
Padding Token<|vision_pad|>
Vocabulary Size152064
Torch Data Typebfloat16

Quantized Models of the DeepSeek R1 Distill Qwen 7B Unsloth Bnb 4bit

Model
Likes
Downloads
VRAM
Novius Argis112315 GB

Best Alternatives to DeepSeek R1 Distill Qwen 7B Unsloth Bnb 4bit

Best Alternatives
Context / RAM
Downloads
Likes
Qwen2.5 7B Instruct 1M 4bit986K / 4.3 GB44411
...wen2.5 7B Instruct 1M Bnb 4bit986K / 5.5 GB2671
Qwen2.5 7B Instruct 1M 8bit986K / 8.1 GB634
Qwen2.5 7B Instruct 1M 6bit986K / 6.2 GB522
...B Instruct 1M Unsloth Bnb 4bit986K / 7.5 GB373
Qwen 7B Kiberbase128K / 15.2 GB7880
A1 V002128K / 15.2 GB70
Mini Pathfinder128K / 15.2 GB160
A1 V0.0.1128K / 15.2 GB80
CogitoDistil128K / 15.2 GB140
Note: green Score (e.g. "73.2") means that the model is better than unsloth/DeepSeek-R1-Distill-Qwen-7B-unsloth-bnb-4bit.