LLM EXPLORER 60,828 MODELS INDEXED

Yi 9B by 01-ai

By 01-ai · 8984 downloads

Yi 9B is an open-source language model by 01-ai. Features: 9b LLM, VRAM: 17.6GB, Context: 4K, License: apache-2.0, LLM Explorer Score: 0.22, Arc: 61.2, HellaSwag: 78.8, MMLU: 70.1, GSM8K: 49.

  Arxiv:2311.16502   Arxiv:2401.11944   Arxiv:2403.04652   Deploy:azure   Endpoints compatible   Llama   Region:us   Safetensors   Sharded   Tensorflow
Model Card on HF πŸ€—: https://huggingface.co/01-ai/Yi-9B 

Yi 9B Parameters and Internals

Model Type 
text generation, chat
Use Cases 
Areas:
research, commercial applications, personal use
Primary Use Cases:
text and chat generation
Limitations:
May produce hallucinations, Non-determinism in re-generation, Cumulative error potential
Considerations:
Adjust generation parameters for diverse responses
Additional Notes 
Yi is based on Llama architecture but not a derivative; independently trained.
Supported Languages 
English (high), Chinese (high)
Training Details 
Data Sources:
multilingual corpus, custom datasets developed by Yi
Data Volume:
3T tokens
Methodology:
Supervised Fine-Tuning (SFT) for chat models
Context Length:
200000
Training Time:
unknown
Hardware Used:
NVIDIA A800, GPU environment
Model Architecture:
Transformer-based, similar to Llama
Responsible Ai Considerations 
Fairness:
Not detailed
Transparency:
Open-source distribution under Apache 2.0
Accountability:
Not specified
Mitigation Strategies:
Uses compliance checking algorithms to maximize data compliance
Input Output 
Input Format:
Text input for prompts
Accepted Modalities:
text
Output Format:
Generated text output
Performance Tips:
Use appropriate generation settings (temperature, top_p) for task diversity
Release Notes 
Version:
Yi 1.5
Date:
2024-05-13
Notes:
Improved coding, math, reasoning abilities
LLM NameYi 9B
Repository πŸ€—https://huggingface.co/01-ai/Yi-9B 
Model Size9b
Required VRAM17.6 GB
Updated2026-09-10
Maintainer01-ai
Model Typellama
Model Files  9.9 GB: 1-of-2   7.7 GB: 2-of-2
Model ArchitectureLlamaForCausalLM
Licenseapache-2.0
Context Length4096
Model Max Length4096
Transformers Version4.37.2
Tokenizer ClassLlamaTokenizer
Padding Token<unk>
Vocabulary Size64000
Torch Data Typebfloat16

Quantized Models of the Yi 9B

Model
Likes
Downloads
VRAM
Yi 9B GGUF153703 GB

Best Alternatives to Yi 9B

Best Alternatives
Context / RAM
Downloads
Likes
Yi 9B 200K256K / 17.7 GB883078
SekhmetX 9B V0.1 Test256K / 21.2 GB712
SekmetX 9B V0.1 Test256K / 21.2 GB692
Austral Xgen 9B Winton256K / 21.3 GB102
...rce Xgen Small 9B Rebased V0.1256K / 42.5 GB170
...rce Xgen Small 9B Rebased V0.1256K / 42.5 GB140
Mike Hawk 9B256K / 21.3 GB33
Xgen Small 9B Instruct R256K / 42.5 GB4411
Xgen Small 9B Base R256K / 42.5 GB472
BigYi 15.75B 200K256K / 30.3 GB90