LLM EXPLORER 61,755 MODELS INDEXED

Qwen3.8 4B Distilled by Ma7ee7

By Ma7ee7 · 90 downloads
HF Repo ↗ Copy URL

Qwen3.8 4B Distilled is an open-source language model by Ma7ee7. Features: 4b LLM, VRAM: 8.1GB, Context: 256K, License: apache-2.0, Quantized, LLM Explorer Score: 0.26.

  4bit Base model:finetune:unsloth/qw... Base model:unsloth/qwen3-4b-th...   Conversational   En   Endpoints compatible   Quantized   Qwen3   Region:us   Safetensors   Sharded   Tensorflow   Unsloth
Model Card on HF 🤗: https://huggingface.co/Ma7ee7/Qwen3.8_4B_Distilled 

Qwen3.8 4B Distilled Parameters and Internals

LLM NameQwen3.8 4B Distilled
Repository 🤗https://huggingface.co/Ma7ee7/Qwen3.8_4B_Distilled 
Base Model(s)  ...Thinking 2507 Unsloth Bnb 4bit   unsloth/Qwen3-4B-Thinking-2507-unsloth-bnb-4bit
Model Size4b
Required VRAM8.1 GB
Updated2026-08-04
MaintainerMa7ee7
Model Typeqwen3
Model Files  5.0 GB: 1-of-2   3.1 GB: 2-of-2
Supported Languagesen
Quantization Type4bit
Model ArchitectureQwen3ForCausalLM
Licenseapache-2.0
Context Length262144
Model Max Length262144
Tokenizer ClassQwen2Tokenizer
Padding Token<|vision_pad|>
Vocabulary Size151936
Torch Data Typebfloat16
Errorsreplace

Quantized Models of the Qwen3.8 4B Distilled

Model
Likes
Downloads
VRAM
Qwen3.8 4B Distilled GGUF16340852 GB

Best Alternatives to Qwen3.8 4B Distilled

Best Alternatives
Context / RAM
Downloads
Likes
Qwen3 4b Merged Txt256K / 8.1 GB5350
...Instruct 2507 Unsloth Bnb 4bit256K / 3.5 GB9469417
Mini Coder 4B OptiQ 4bit256K / 3 GB3101
...wen3 4B Thinking 2507 MLX 4bit256K / 2.3 GB5322514
...wen3 4B Thinking 2507 MLX 8bit256K / 4.3 GB447318
Qwen3 4B Instruct 2507 4bit256K / 2.3 GB4095511
FastContext 1.0 4B SFT 8bit256K / 4.3 GB1201
...wen 3 4b Mythos Finetune 16bit256K / 8.1 GB920
EduMentor Qwen3 4B FP16256K / 8.1 GB751
...4B Cybersecurity Heretic 16bit256K / 8.1 GB4665
Note: green Score (e.g. "73.2") means that the model is better than Ma7ee7/Qwen3.8_4B_Distilled.