LLM EXPLORER 55,709 MODELS INDEXED

Aya Vision 8B 6bit by mlx-community

By mlx-community · 24 downloads

Aya Vision 8B 6bit is an open-source language model by mlx-community. Features: 8b LLM, VRAM: 7.4GB, License: cc-by-nc-4.0, Quantized.

  6bit   Ar   Aya vision   Conversational   Cs   De   El   En   Es   Fa   Fr   He   Hi   Id   Image-text-to-text   It   Ja   Ko   Mlx   Nl   Pl   Pt   Quantized   Region:us   Ro   Ru   Safetensors   Sharded   Tensorflow   Tr   Uk   Vi   Vision   Zh

Aya Vision 8B 6bit Parameters and Internals

LLM NameAya Vision 8B 6bit
Repository πŸ€—https://huggingface.co/mlx-community/aya-vision-8b-6bit 
Model Size8b
Required VRAM7.4 GB
Updated2026-08-08
Maintainermlx-community
Model Typeaya_vision
Model Files  5.3 GB: 1-of-2   2.1 GB: 2-of-2
Supported Languagesen fr de es it pt ja ko zh ar el fa pl id cs he hi nl ro ru tr uk vi
Quantization Type6bit
Model ArchitectureAyaVisionForConditionalGeneration
Licensecc-by-nc-4.0
Transformers Version4.50.0.dev0
Tokenizer ClassCohereTokenizer
Padding Token<PAD>
Torch Data Typefloat16

Best Alternatives to Aya Vision 8B 6bit

Best Alternatives
Context / RAM
Downloads
Likes
Aya Vision 8B 3bit0K / 4.4 GB191
Aya Vision 8B 4bit0K / 5.4 GB441
Aya Vision 8B 8bit0K / 9.5 GB923