LLM EXPLORER
 LLM Explorer: A Curated Large Language Model Directory and Analytics
Dark Theme
  Agents   Benchmarks   LLM  List    LLM Hosting    LLM Leaderboards    Blog    Newsfeed    Advertise

Dolphin 2.9.1 Yi 1.5 34B 3.0bpw H6 EXL2 by LoneStriker

 »  All LLMs  »  LoneStriker  »  Dolphin 2.9.1 Yi 1.5 34B 3.0bpw H6 EXL2   URL Share it on

  1   

Dolphin 2.9.1 Yi 1.5 34B 3.0bpw H6 EXL2 is an open-source language model by LoneStriker. Features: 34b LLM, VRAM: 13.9GB, Context: 8K, License: apache-2.0, Quantized, LLM Explorer Score: 0.13.

  3-bit   Axolotl   Base model:01-ai/yi-1.5-34b Base model:quantized:01-ai/yi-...   Conversational Dataset:cognitivecomputations/... Dataset:cognitivecomputations/... Dataset:cognitivecomputations/...   Dataset:internlm/agent-flan Dataset:locutusque/function-ca... Dataset:m-a-p/codefeedback-fil... Dataset:microsoft/orca-math-wo...   Dataset:teknium/openhermes-2.5   Endpoints compatible   Exl2   Generated from trainer   Llama   Quantized   Region:us   Safetensors   Sharded   Tensorflow
Model Card on HF 🤗: https://huggingface.co/LoneStriker/dolphin-2.9.1-yi-1.5-34b-3.0bpw-h6-exl2 

Dolphin 2.9.1 Yi 1.5 34B 3.0bpw H6 EXL2 Benchmarks

LLME Score: 0.13487
nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
Dolphin 2.9.1 Yi 1.5 34B 3.0bpw H6 EXL2 (LoneStriker/dolphin-2.9.1-yi-1.5-34b-3.0bpw-h6-exl2)
🌟 Advertise your project 🚀

Dolphin 2.9.1 Yi 1.5 34B 3.0bpw H6 EXL2 Parameters and Internals

Model Type 
LlamaForCausalLM
Additional Notes 
Dolphin-2.9.1 has a variety of instruction, conversational, and coding skills. It supports function calling and has initial agentic abilities.
Training Details 
Data Sources:
cognitivecomputations/Dolphin-2.9, teknium/OpenHermes-2.5, m-a-p/CodeFeedback-Filtered-Instruction, cognitivecomputations/dolphin-coder, cognitivecomputations/samantha-data, microsoft/orca-math-word-problems-200k, Locutusque/function-calling-chatml, internlm/Agent-FLAN
Methodology:
Full-weight fine-tuning with sequence length 8k, using Axolotl framework.
Input Output 
Input Format:
ChatML prompt template format
LLM NameDolphin 2.9.1 Yi 1.5 34B 3.0bpw H6 EXL2
Repository 🤗https://huggingface.co/LoneStriker/dolphin-2.9.1-yi-1.5-34b-3.0bpw-h6-exl2 
Base Model(s)  01-ai/Yi-1.5-34B   01-ai/Yi-1.5-34B
Model Size34b
Required VRAM13.9 GB
Updated2026-02-01
MaintainerLoneStriker
Model Typellama
Model Files  8.6 GB: 1-of-2   5.3 GB: 2-of-2
Quantization Typeexl2
Model ArchitectureLlamaForCausalLM
Licenseapache-2.0
Context Length8192
Model Max Length8192
Transformers Version4.40.0.dev0
Tokenizer ClassLlamaTokenizer
Padding Token<unk>
Vocabulary Size64000
Torch Data Typebfloat16

Best Alternatives to Dolphin 2.9.1 Yi 1.5 34B 3.0bpw H6 EXL2

Best Alternatives
Context / RAM
Downloads
Likes
...34B 200K Aezakmi Raw 1902 EXL2195K / 20.7 GB51
Yi 34B 200K RPMerge195K / 68.9 GB9160
Yi 34B 200K MAR2024 EXL2 4bpw195K / 18 GB41
...B 200K RPMerge 4.65bpw H6 EXL2195K / 10.5 GB52
...mi Raw Toxic 2702 4.65bpw EXL2195K / 20.8 GB12
Opus V1 34B 5.0bpw H6 EXL2195K / 22.3 GB52
Opus V1 34B 4.0bpw H6 EXL2195K / 18 GB31
Opus V1 34B 8.0bpw H8 EXL2195K / 34.8 GB31
34B Beta 4.0bpw H6 EXL2195K / 18.1 GB81
34B Beta 5.0bpw H6 EXL2195K / 22.3 GB81

Rank the Dolphin 2.9.1 Yi 1.5 34B 3.0bpw H6 EXL2 Capabilities

🆘 Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! 🌟

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 52721 in total.

Email us: info@extractum.io. Our Privacy Policy  | Terms and Conditions  | Suggest an improvement.
Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Check out Ag3ntum — our secure, self-hosted AI agent for server management.
Release v20260328a
  Support LLM Explorer