LLM EXPLORER 59,420 MODELS INDEXED

Yi 6B GGUF by TheBloke

By TheBloke · 889 downloads

Yi 6B GGUF is an open-source language model by TheBloke. Features: 6b LLM, VRAM: 2.6GB, License: other, Quantized, LLM Explorer Score: 0.1.

  Base model:01-ai/yi-6b Base model:quantized:01-ai/yi-...   Gguf   Quantized   Region:us   Yi
Model Card on HF πŸ€—: https://huggingface.co/TheBloke/Yi-6B-GGUF 

Yi 6B GGUF Parameters and Internals

Model Type 
text-generation
Additional Notes 
The model supports high sequence lengths extended to 32K during inference.
Supported Languages 
English (Bilingual proficiency), Chinese (Bilingual proficiency)
Input Output 
Input Format:
{prompt}
Accepted Modalities:
text
LLM NameYi 6B GGUF
Repository πŸ€—https://huggingface.co/TheBloke/Yi-6B-GGUF 
Model NameYi 6B
Model Creator01-ai
Base Model(s)  Yi 6B   01-ai/Yi-6B
Model Size6b
Required VRAM2.6 GB
Updated2026-08-08
MaintainerTheBloke
Model Typeyi
Model Files  2.6 GB   3.2 GB   3.0 GB   2.7 GB   3.5 GB   3.7 GB   3.5 GB   4.2 GB   4.3 GB   4.2 GB   5.0 GB   6.4 GB
GGUF QuantizationYes
Quantization Typegguf
Model ArchitectureAutoModel
Licenseother

Best Alternatives to Yi 6B GGUF

Best Alternatives
Context / RAM
Downloads
Likes
Yi 1.5 6B Chat GGUF0K / 2.3 GB954289
Yi 1.5 6B Tofutune Gguf0K / 3.7 GB220
Yi 6B 200K GGUF0K / 2.3 GB1630
Dragon Yi 6B V0 GGUF0K / 2.6 GB57915
Yi 6B 200K GGUF0K / 2.6 GB50728
GPT J GGML0K / 3.4 GB102
Ct2fast Codegen 6B Multi0K / 14.1 GB61
Ct2fast Codegen 6B Mono0K / 14.1 GB51
Ct2fast GPT JT 6B V00K / 12.1 GB51
Ct2fast GPT J 6B0K / 12.1 GB42
Note: green Score (e.g. "73.2") means that the model is better than TheBloke/Yi-6B-GGUF.