LLM EXPLORER 58,178 MODELS INDEXED

Jan V3 4B Base Instruct 4bit by mlx-community

By mlx-community · 279 downloads
HF Repo ↗ Copy URL

Jan V3 4B Base Instruct 4bit is an open-source language model by mlx-community. Features: 4b LLM, VRAM: 2.3GB, Context: 256K, License: apache-2.0, Quantized, Instruction-Based, LLM Explorer Score: 0.23.

  4-bit   4bit Base model:janhq/jan-v3-4b-bas... Base model:quantized:janhq/jan...   Code   Conversational   En   Instruct   Mlx   Quantized   Qwen3   Region:us   Safetensors
Model Card on HF 🤗: https://huggingface.co/mlx-community/Jan-v3-4B-base-instruct-4bit 

Jan V3 4B Base Instruct 4bit Parameters and Internals

LLM NameJan V3 4B Base Instruct 4bit
Repository 🤗https://huggingface.co/mlx-community/Jan-v3-4B-base-instruct-4bit 
Base Model(s)  Jan V3 4B Base Instruct   janhq/Jan-v3-4B-base-instruct
Model Size4b
Required VRAM2.3 GB
Updated2026-07-30
Maintainermlx-community
Model Typeqwen3
Instruction-BasedYes
Model Files  2.3 GB
Supported Languagesen
Quantization Type4bit
Model ArchitectureQwen3ForCausalLM
Licenseapache-2.0
Context Length262144
Model Max Length262144
Transformers Version4.57.1
Tokenizer ClassQwen2Tokenizer
Padding Token<|endoftext|>
Vocabulary Size151936
Errorsreplace

Best Alternatives to Jan V3 4B Base Instruct 4bit

Best Alternatives
Context / RAM
Downloads
Likes
Qwen3 4b Merged Txt256K / 8.1 GB5350
...Instruct 2507 Unsloth Bnb 4bit256K / 3.5 GB15596214
...wen 3 4b Mythos Finetune 16bit256K / 8.1 GB920
Qwen3 4B Instruct 2507 4bit256K / 2.3 GB4095511
Qwen3 4B INST Code256K / 8.1 GB250
Qwen3 4B INST Math256K / 8.1 GB180
...Instruct Haiku 4.5 Merged FP16256K / 8.1 GB161
Agent 4b256K / 8.1 GB160
...wen3 4B Instruct 2507 Bnb 4bit256K / 2.6 GB68335
Fact Extractor Dev 1b256K / 8.1 GB200
Note: green Score (e.g. "73.2") means that the model is better than mlx-community/Jan-v3-4B-base-instruct-4bit.