Bnb DPO 8bit by syrinenoamen

 »  All LLMs  »  syrinenoamen  »  Bnb DPO 8bit   URL Share it on

Bnb DPO 8bit is an open-source language model by syrinenoamen. Features: 2.8b LLM, VRAM: 3GB, Context: 2K, Quantized, LLM Explorer Score: 0.14.

  8-bit   8bit   Autotrain compatible   Bitsandbytes   Endpoints compatible   Phi   Quantized   Region:us   Safetensors

Bnb DPO 8bit Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").

Bnb DPO 8bit Parameters and Internals

LLM NameBnb DPO 8bit
Repository 🤗https://huggingface.co/syrinenoamen/bnb_dpo_8bit 
Model Size2.8b
Required VRAM3 GB
Updated2025-09-23
Maintainersyrinenoamen
Model Typephi
Model Files  3.0 GB
Quantization Type8bit
Model ArchitecturePhiForCausalLM
Context Length2048
Model Max Length2048
Transformers Version4.41.1
Tokenizer ClassCodeGenTokenizer
Padding Token<pad><pad><pad>
Vocabulary Size50296
Torch Data Typefloat16

Best Alternatives to Bnb DPO 8bit

Best Alternatives
Context / RAM
Downloads
Likes
Bnb DPO 8bit2K / 3 GB70
Phi 2 4bit 64rank2K / 5.6 GB160
Phi 2 Nf4 Fp16 Upscaled2K / 5.6 GB60
MFANN3bv0.24128K / 11.1 GB50
MFANN3b128K / 11.1 GB1680
MFANN3bv1.4128K / 11.1 GB50
MFANN Phigments Slerp V3.2128K / 5.6 GB70
MFANN3bv1.3128K / 11.1 GB90
MFANN3bv0.23128K / 11.1 GB50
MFANN3bv1.1128K / 11.1 GB50
Note: green Score (e.g. "73.2") means that the model is better than syrinenoamen/bnb_dpo_8bit.

Rank the Bnb DPO 8bit Capabilities

🆘 Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! 🌟

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 53999 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Check out Ag3ntum — our secure, self-hosted AI agent for server management.
Release v20260328a