LLM EXPLORER 57,918 MODELS INDEXED

Aya Vision 8B Bnb 4bit by unsloth

By unsloth · 138 downloads

Aya Vision 8B Bnb 4bit is an open-source language model by unsloth. Features: 8b LLM, VRAM: 6.3GB, License: cc-by-nc-4.0, Quantized, LLM Explorer Score: 0.17.

  Arxiv:2412.04261   4-bit   4bit   Ar   Aya vision Base model:coherelabs/aya-visi... Base model:quantized:coherelab...   Bitsandbytes   Conversational   Cs   De   El   En   Es   Fa   Fr   He   Hi   Id   Image-text-to-text   It   Ja   Ko   Nl   Pl   Pt   Quantized   Region:us   Ro   Ru   Safetensors   Tr   Uk   Vi   Vision   Zh

Aya Vision 8B Bnb 4bit Parameters and Internals

LLM NameAya Vision 8B Bnb 4bit
Repository πŸ€—https://huggingface.co/unsloth/aya-vision-8b-bnb-4bit 
Base Model(s)  CohereForAI/aya-vision-8b   CohereForAI/aya-vision-8b
Model Size8b
Required VRAM6.3 GB
Updated2026-08-10
Maintainerunsloth
Model Typeaya_vision
Model Files  6.3 GB
Supported Languagesen fr de es it pt ja ko zh ar el fa pl id cs he hi nl ro ru tr uk vi
Quantization Type4bit
Model ArchitectureAyaVisionForConditionalGeneration
Licensecc-by-nc-4.0
Model Max Length16384
Transformers Version4.50.0.dev0
Tokenizer ClassCohereTokenizer
Padding Token<PAD>
Torch Data Typebfloat16

Best Alternatives to Aya Vision 8B Bnb 4bit

Best Alternatives
Context / RAM
Downloads
Likes
Aya Vision 8B 8bit0K / 9.5 GB923
Aya Vision 8B 4bit0K / 5.4 GB441
Aya Vision 8B 6bit0K / 7.4 GB242
Aya Vision 8B 3bit0K / 4.4 GB191
Aya Vision 8B0K / 17.2 GB531