Bnb DPO 8bit is an open-source language model by syr99. Features: 2.8b LLM, VRAM: 3GB, Context: 2K, Quantized, LLM Explorer Score: 0.12.
| LLM Name | Bnb DPO 8bit |
| Repository 🤗 | https://huggingface.co/syr99/bnb_dpo_8bit |
| Model Size | 2.8b |
| Required VRAM | 3 GB |
| Updated | 2025-05-26 |
| Maintainer | syr99 |
| Model Type | phi |
| Model Files | |
| Quantization Type | 8bit |
| Model Architecture | PhiForCausalLM |
| Context Length | 2048 |
| Model Max Length | 2048 |
| Transformers Version | 4.41.1 |
| Tokenizer Class | CodeGenTokenizer |
| Padding Token | <pad><pad><pad> |
| Vocabulary Size | 50296 |
| Torch Data Type | float16 |
Best Alternatives |
Context / RAM |
Downloads |
Likes |
|---|---|---|---|
| Bnb DPO 8bit | 2K / 3 GB | 7 | 0 |
| Phi 2 4bit 64rank | 2K / 5.6 GB | 13 | 0 |
| Phi 2 Nf4 Fp16 Upscaled | 2K / 5.6 GB | 8 | 0 |
| MFANN3bv0.24 | 128K / 11.1 GB | 6 | 0 |
| MFANN3b | 128K / 11.1 GB | 86 | 0 |
| MFANN3bv1.4 | 128K / 11.1 GB | 8 | 0 |
| MFANN Phigments Slerp V3.2 | 128K / 5.6 GB | 6 | 0 |
| MFANN3bv1.3 | 128K / 11.1 GB | 14 | 0 |
| MFANN3bv0.23 | 128K / 11.1 GB | 10 | 0 |
| MFANN3bv1.1 | 128K / 11.1 GB | 10 | 0 |