Yi 6B is an open-source language model by 01-ai. Features: 6b LLM, VRAM: 12.1GB, Context: 4K, License: apache-2.0, LLM Explorer Score: 0.22, Arc: 83.8, HellaSwag: 73.1, MMLU: 64, GSM8K: 39.9.
Yi 6B Parameters and Internals
Model Type Use Cases
Areas: research, commercial applications, personal use
Primary Use Cases: Limitations: May produce hallucinations, Non-determinism in re-generation, Cumulative error potential
Considerations: Adjust generation parameters for diverse responses
Additional Notes Yi is based on Llama architecture but not a derivative; independently trained.
Supported Languages English (high), Chinese (high)
Training Details
Data Sources: multilingual corpus, custom datasets developed by Yi
Data Volume: Methodology: Supervised Fine-Tuning (SFT) for chat models
Context Length: Training Time: Hardware Used: NVIDIA A800, GPU environment
Model Architecture: Transformer-based, similar to Llama
Responsible Ai Considerations
Fairness: Transparency: Open-source distribution under Apache 2.0
Accountability: Mitigation Strategies: Uses compliance checking algorithms to maximize data compliance
Input Output
Input Format: Accepted Modalities: Output Format: Performance Tips: Use appropriate generation settings (temperature, top_p) for task diversity
Release Notes
Version: Date: Notes: Improved coding, math, reasoning abilities
Rank the Yi 6B capabilities
Have you tried this model? Rate its performance — this feedback helps the ML community find the right model for their needs.
Instruction Following and Task Automation
Factuality and Completeness of Knowledge
Censorship and Alignment
Data Analysis and Insight Generation
Text Generation
Text Summarization and Feature Extraction
Code Generation
Multi-Language Support and Translation
Quantized Models of the Yi 6B
Best Alternatives to Yi 6B
Expand