LLM EXPLORER 63,407 MODELS INDEXED

Faro Yi 9B DPO 8bpw EXL2 by vikarti-anatra

By vikarti-anatra · 2 downloads

Faro Yi 9B DPO 8bpw EXL2 is an open-source language model by vikarti-anatra. Features: 9b LLM, VRAM: 8.3GB, Context: 32K, License: mit, Quantized, LLM Explorer Score: 0.12.

  Arxiv:2303.08774   8-bit   Conversational Dataset:argilla/ultrafeedback-...   Dataset:intel/orca dpo pairs Dataset:jondurbin/truthy-dpo-v... Dataset:wenbopan/chinese-dpo-p...   En   Endpoints compatible   Exl2   Llama   Quantized   Region:us   Safetensors   Zh

Faro Yi 9B DPO 8bpw EXL2 Parameters and Internals

Model Type 
text generation
Supported Languages 
en (excellent), zh (excellent)
LLM NameFaro Yi 9B DPO 8bpw EXL2
Repository πŸ€—https://huggingface.co/vikarti-anatra/Faro-Yi-9B-DPO-8bpw-exl2 
Model Size9b
Required VRAM8.3 GB
Updated2026-07-21
Maintainervikarti-anatra
Model Typellama
Model Files  8.3 GB
Supported Languagesen zh
Quantization Typeexl2
Model ArchitectureLlamaForCausalLM
Licensemit
Context Length32768
Model Max Length32768
Transformers Version4.39.3
Tokenizer ClassLlamaTokenizer
Padding Token<unk>
Vocabulary Size64000
Torch Data Typebfloat16

Best Alternatives to Faro Yi 9B DPO 8bpw EXL2

Best Alternatives
Context / RAM
Downloads
Likes
Yi 9B 200K 3.0bpw H6 EXL2256K / 3.9 GB61
Yi 9B 200K 6.0bpw H6 EXL2256K / 7 GB31
Faro Yi 9B DPO 6bpw EXL232K / 7 GB31
...5 9B Chat Quantized Merge 4Bit7K / 34 GB60
Master Yi 9B 8.0bpw H8 EXL24K / 8.7 GB32
Master Yi 9B 3.0bpw H6 EXL24K / 3.9 GB41
Master Yi 9B 5.0bpw H6 EXL24K / 5.9 GB41
Master Yi 9B 4.0bpw H6 EXL24K / 4.9 GB31
Master Yi 9B 6.0bpw H6 EXL24K / 7 GB31
Yi 1.5 9B 8bit4K / 9.3 GB71
Note: green Score (e.g. "73.2") means that the model is better than vikarti-anatra/Faro-Yi-9B-DPO-8bpw-exl2.