LLM EXPLORER 64,561 MODELS INDEXED

Yi 6B 200K GGUF by MaziyarPanahi

By MaziyarPanahi · 163 downloads

Yi 6B 200K GGUF is an open-source language model by MaziyarPanahi. Features: 6b LLM, VRAM: 2.3GB, Quantized, LLM Explorer Score: 0.11.

  Arxiv:2311.16502   Arxiv:2401.11944   Arxiv:2403.04652   2-bit   3-bit   4-bit   5-bit   6-bit   8-bit   Autotrain compatible   Base model:01-ai/yi-6b-200k Base model:quantized:01-ai/yi-...   Endpoints compatible   Gguf   Has space   Llama   Mistral   Pytorch   Quantized   Region:us   Safetensors

Yi 6B 200K GGUF Parameters and Internals

Model Type 
text-generation
LLM NameYi 6B 200K GGUF
Repository πŸ€—https://huggingface.co/MaziyarPanahi/Yi-6B-200K-GGUF 
Model NameYi-6B-200K-GGUF
Model Creator01-ai
Base Model(s)  Yi 6B 200K   01-ai/Yi-6B-200K
Model Size6b
Required VRAM2.3 GB
Updated2026-08-07
MaintainerMaziyarPanahi
Model Typemistral
Model Files  3.3 GB   2.3 GB   3.2 GB   3.0 GB   2.7 GB   3.7 GB   3.5 GB   4.3 GB   4.2 GB   5.0 GB   6.4 GB   12.1 GB
GGUF QuantizationYes
Quantization Typegguf
Model ArchitectureAutoModel

Best Alternatives to Yi 6B 200K GGUF

Best Alternatives
Context / RAM
Downloads
Likes
Yi 1.5 6B Chat GGUF0K / 2.3 GB954289
Yi 1.5 6B Tofutune Gguf0K / 3.7 GB220
Yi 6B GGUF0K / 2.6 GB88914
Dragon Yi 6B V0 GGUF0K / 2.6 GB57915
Yi 6B 200K GGUF0K / 2.6 GB50728
GPT J GGML0K / 3.4 GB102
Ct2fast Codegen 6B Multi0K / 14.1 GB61
Ct2fast Codegen 6B Mono0K / 14.1 GB51
Ct2fast GPT JT 6B V00K / 12.1 GB51
Ct2fast GPT J 6B0K / 12.1 GB42
Note: green Score (e.g. "73.2") means that the model is better than MaziyarPanahi/Yi-6B-200K-GGUF.