LLM EXPLORER 61,491 MODELS INDEXED

Yi 34B 200K 4.65bpw H6 EXL2 by LoneStriker

By LoneStriker · 5 downloads
HF Repo ↗ Copy URL

Yi 34B 200K 4.65bpw H6 EXL2 is an open-source language model by LoneStriker. Features: 34b LLM, VRAM: 20.8GB, Context: 195K, License: other, Quantized, LLM Explorer Score: 0.09.

  Custom code   Exl2   Pytorch   Quantized   Region:us   Sharded   Tensorflow   Yi
Model Card on HF 🤗: https://huggingface.co/LoneStriker/Yi-34B-200K-4.65bpw-h6-exl2 

Yi 34B 200K 4.65bpw H6 EXL2 Parameters and Internals

Model Type 
Large Language Model
Supported Languages 
English (Bilingual), Chinese (Bilingual)
Release Notes 
Version:
Yi-6B-200K
Date:
2023/11/06
Notes:
Base model release with 200K context length
Version:
Yi-6B
Date:
2023/11/02
Notes:
Base model release
LLM NameYi 34B 200K 4.65bpw H6 EXL2
Repository 🤗https://huggingface.co/LoneStriker/Yi-34B-200K-4.65bpw-h6-exl2 
Model Size34b
Required VRAM20.8 GB
Updated2026-07-22
MaintainerLoneStriker
Model TypeYi
Model Files  8.6 GB: 1-of-3   8.6 GB: 2-of-3   3.6 GB: 3-of-3
Quantization Typeexl2
Model ArchitectureYiForCausalLM
Licenseother
Context Length200000
Model Max Length200000
Transformers Version4.34.0
Tokenizer ClassYiTokenizer
Vocabulary Size64000
Torch Data Typebfloat16

Best Alternatives to Yi 34B 200K 4.65bpw H6 EXL2

Best Alternatives
Context / RAM
Downloads
Likes
...lpaca Rpv3 Scipy 4bpw Hb6 EXL2195K / 18.7 GB102
...200K Alpaca Rpv3 4bpw Hb6 EXL2195K / 18.7 GB22
Yi 34B 200K 4.0bpw H6 EXL2195K / 18.1 GB43
Yi 34B 200K 8.0bpw H8 EXL2195K / 34.8 GB23
Yi 34B 200K 5.0bpw H6 EXL2195K / 22.3 GB41
Deepsex 34B 4bpw H8 EXL24K / 18.1 GB106
Deepsex 34B 4bpw H6 EXL24K / 18.1 GB24
Yi 34B 5.0bpw H6 EXL24K / 22.2 GB113
Yi 34B 4.0bpw H6 EXL24K / 18.1 GB61
Yi 34B 8.0bpw H8 EXL24K / 34.9 GB21
Note: green Score (e.g. "73.2") means that the model is better than LoneStriker/Yi-34B-200K-4.65bpw-h6-exl2.