LLM EXPLORER 55,709 MODELS INDEXED

Aya Vision 8B 4bit by mlx-community

By mlx-community · 44 downloads

Aya Vision 8B 4bit is an open-source language model by mlx-community. Features: 8b LLM, VRAM: 5.4GB, License: cc-by-nc-4.0, Quantized.

  4bit   Ar   Aya vision   Conversational   Cs   De   El   En   Es   Fa   Fr   He   Hi   Id   Image-text-to-text   It   Ja   Ko   Mlx   Nl   Pl   Pt   Quantized   Region:us   Ro   Ru   Safetensors   Sharded   Tensorflow   Tr   Uk   Vi   Vision   Zh

Aya Vision 8B 4bit Parameters and Internals

LLM NameAya Vision 8B 4bit
Repository πŸ€—https://huggingface.co/mlx-community/aya-vision-8b-4bit 
Model Size8b
Required VRAM5.4 GB
Updated2026-08-08
Maintainermlx-community
Model Typeaya_vision
Model Files  5.3 GB: 1-of-2   0.1 GB: 2-of-2
Supported Languagesen fr de es it pt ja ko zh ar el fa pl id cs he hi nl ro ru tr uk vi
Quantization Type4bit
Model ArchitectureAyaVisionForConditionalGeneration
Licensecc-by-nc-4.0
Transformers Version4.50.0.dev0
Tokenizer ClassCohereTokenizer
Padding Token<PAD>
Torch Data Typefloat16

Best Alternatives to Aya Vision 8B 4bit

Best Alternatives
Context / RAM
Downloads
Likes
Aya Vision 8B 3bit0K / 4.4 GB191
Aya Vision 8B 6bit0K / 7.4 GB242
Aya Vision 8B 8bit0K / 9.5 GB923