LLM EXPLORER 61,491 MODELS INDEXED

Yi 34B Chat by 01-ai

By 01-ai · 31123 downloads

Yi 34B Chat is an open-source language model by 01-ai. Features: 34b LLM, VRAM: 69.2GB, Context: 4K, License: apache-2.0, LLM Explorer Score: 0.36, ELO: 1183, Arc: 65.1, HellaSwag: 84.1, MMLU: 74.9, GSM8K: 19.8.

  Arxiv:2311.16502   Arxiv:2401.11944   Arxiv:2403.04652   Conversational   Deploy:azure   Endpoints compatible   Llama   Region:us   Safetensors   Sharded   Tensorflow
Model Card on HF πŸ€—: https://huggingface.co/01-ai/Yi-34B-Chat 

Yi 34B Chat Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").

Yi 34B Chat Parameters and Internals

Model Type 
Text Generation, Multimodal
Use Cases 
Areas:
Personal, Academic, Commercial
Applications:
Code generation, Math solutions, Commonsense reasoning, Reading comprehension
Limitations:
Hallucination potential, Non-determinism in response generation, Cumulative error in extended tasks
Considerations:
Adjust generation configuration parameters such as temperature, top_p, or top_k to improve output consistency.
Supported Languages 
English (B), Chinese (B)
Training Details 
Data Sources:
3T multilingual corpus
Model Architecture:
Transformer and Llama architectures
Input Output 
Accepted Modalities:
text
Output Format:
text
Performance Tips:
Recommendations to adjust temperature, top_p, or top_k settings for better output.
Release Notes 
Version:
Yi-34B
Date:
2023-11-02
Notes:
Initial open-source release of Yi-34B and Yi-6B base models.
Version:
Yi-9B
Date:
2024-03-06
Notes:
Yi-9B becomes the top performer among similar-sized open-source models in coding, math, and reasoning.
LLM NameYi 34B Chat
Repository πŸ€—https://huggingface.co/01-ai/Yi-34B-Chat 
Model Size34b
Required VRAM69.2 GB
Updated2026-09-18
Maintainer01-ai
Model Typellama
Model Files  4.8 GB: 1-of-15   4.8 GB: 2-of-15   5.0 GB: 3-of-15   4.8 GB: 4-of-15   4.8 GB: 5-of-15   5.0 GB: 6-of-15   4.8 GB: 7-of-15   4.8 GB: 8-of-15   5.0 GB: 9-of-15   4.8 GB: 10-of-15   4.8 GB: 11-of-15   5.0 GB: 12-of-15   4.8 GB: 13-of-15   4.8 GB: 14-of-15   1.2 GB: 15-of-15
Model ArchitectureLlamaForCausalLM
Licenseapache-2.0
Context Length4096
Model Max Length4096
Transformers Version4.35.0
Tokenizer ClassLlamaTokenizer
Padding Token<unk>
Vocabulary Size64000
Torch Data Typebfloat16

Quantized Models of the Yi 34B Chat

Model
Likes
Downloads
VRAM
Yi 34B Chat GGUF7588614 GB
Yi 34B Chat GGUF327412 GB
Yi 34B Chat GPTQ165518 GB
Yi 34B Chat AWQ131619 GB

Best Alternatives to Yi 34B Chat

Best Alternatives
Context / RAM
Downloads
Likes
Bagel Hermes 34B Slerp195K / 68.9 GB83751
34B Beta195K / 69.2 GB867067
Smaug 34B V0.1195K / 69.2 GB808264
Casual Magnum 34B195K / 68.8 GB41
Yi 34B 200K195K / 68.9 GB9133320
Bagel 34B V0.2195K / 68.7 GB25941
Yi 34B 200K AEZAKMI V2195K / 69.2 GB5712
Faro Yi 34B195K / 69.2 GB82086
Bagel DPO 34B V0.5195K / 68.7 GB804017
Smaug 34B V0.1 ExPO195K / 69.2 GB78120