LLM EXPLORER 64,811 MODELS INDEXED

LightOnOCR 3 4B 4bit by AnandSingh

By AnandSingh · 119 downloads
HF Repo ↗ Copy URL

LightOnOCR 3 4B 4bit is an open-source language model by AnandSingh. Features: 4b LLM, VRAM: 3GB, License: apache-2.0, Quantized, LLM Explorer Score: 0.29.

  4-bit   4bit Base model:lightonai/lightonoc... Base model:quantized:lightonai...   Conversational   Document-understanding   Grounding   Image-text-to-text   Mlx   Mlx-vlm   Ocr   Quantized   Qwen3 5   Region:us   Safetensors   Vision   Vision-language
Model Card on HF 🤗: https://huggingface.co/AnandSingh/LightOnOCR-3-4B-4bit 

LightOnOCR 3 4B 4bit Parameters and Internals

LLM NameLightOnOCR 3 4B 4bit
Repository 🤗https://huggingface.co/AnandSingh/LightOnOCR-3-4B-4bit 
Base Model(s)  LightOnOCR 3 4B   lightonai/LightOnOCR-3-4B
Model Size4b
Required VRAM3 GB
Updated2026-10-17
MaintainerAnandSingh
Model Typeqwen3_5
Model Files  3.0 GB
Quantization Type4bit
Model ArchitectureQwen3_5ForConditionalGeneration
Licenseapache-2.0
Model Max Length262144
Transformers Version5.5.4
Tokenizer ClassTokenizersBackend
Padding Token<|endoftext|>
Errorsreplace

Best Alternatives to LightOnOCR 3 4B 4bit

Best Alternatives
Context / RAM
Downloads
Likes
Underdog Woof 4B 1.10K / 2.4 GB189223
H2o Lightning 4B Mlx Q80K / 5.1 GB1582
H2o Lightning 4B Mlx Q40K / 3 GB951
Qwen3.5 4B MLX 4bit0K / 3 GB2802332
Loopl 4B 4bit0K / 3 GB1701
Sbzhanzhang0K / 2.4 GB1331
Qwen3.5 4B OptiQ 4bit0K / 0.1 GB782323
Qwen3.5 4B 4bit Abliterated0K / 3 GB851
Fara1.5 4B OptiQ 4bit0K / 3.5 GB2152
Qwen3.5 4B OQ4e FP16 MTP MLX0K / 3.3 GB421
Note: green Score (e.g. "73.2") means that the model is better than AnandSingh/LightOnOCR-3-4B-4bit.