LLM EXPLORER 61,405 MODELS INDEXED

Qwen3.5 Text 4B Bnb 4bit by techwithsergiu

By techwithsergiu · 2125 downloads

Qwen3.5 Text 4B Bnb 4bit is an open-source language model by techwithsergiu. Features: 4b LLM, VRAM: 3.1GB, Context: 256K, License: apache-2.0, Quantized, LLM Explorer Score: 0.25.

  4-bit   4bit Base model:quantized:techwiths... Base model:techwithsergiu/qwen...   Bitsandbytes   Conversational   Endpoints compatible   Quantized   Qwen3 5 text   Region:us   Safetensors   Techwithsergiu

Qwen3.5 Text 4B Bnb 4bit Parameters and Internals

LLM NameQwen3.5 Text 4B Bnb 4bit
Repository πŸ€—https://huggingface.co/techwithsergiu/Qwen3.5-text-4B-bnb-4bit 
Base Model(s)  techwithsergiu/Qwen3.5-text-4B   techwithsergiu/Qwen3.5-text-4B
Model Size4b
Required VRAM3.1 GB
Updated2026-09-16
Maintainertechwithsergiu
Model Typeqwen3_5_text
Model Files  3.1 GB
Quantization Type4bit
Model ArchitectureQwen3_5ForCausalLM
Licenseapache-2.0
Context Length262144
Model Max Length262144
Transformers Version5.3.0.dev0
Tokenizer ClassTokenizersBackend
Padding Token<|vision_pad|>
Vocabulary Size248320
Torch Data Typebfloat16
Errorsreplace

Best Alternatives to Qwen3.5 Text 4B Bnb 4bit

Best Alternatives
Context / RAM
Downloads
Likes
Qwen3.5 4B Qat Lean 4bit Mlx256K / 2.4 GB1550
Qwen3.5 4B Code Forged256K / 8.4 GB1721
NeoHorse 1 4B256K / 8.4 GB1771179
Agents A1 4B Fable Preview256K / 8.4 GB1030
Bible Assistant Qwen3.5 4B V2256K / 8.4 GB13230
Polaris V1256K / 2.7 GB14341
...ts A1 4B Fable Preview Heretic256K / 8.4 GB22852
NeoHorse 1 4B FP8256K / 4.8 GB951
3arabLM 4B Islamic V2256K / 8.4 GB4621
Qwen35 4B T13 Opd Rkl Ckpt50256K / 8.4 GB4670
Note: green Score (e.g. "73.2") means that the model is better than techwithsergiu/Qwen3.5-text-4B-bnb-4bit.