LLM EXPLORER 63,407 MODELS INDEXED

Qlora4b DPO by syr99

By syr99 · 13 downloads

Qlora4b DPO is an open-source language model by syr99. Features: 1.6b LLM, VRAM: 2.5GB, Context: 2K, LLM Explorer Score: 0.12.

  4-bit   Autotrain compatible   Bitsandbytes   Endpoints compatible   Phi   Region:us   Safetensors
Model Card on HF πŸ€—: https://huggingface.co/syr99/qlora4b_dpo 

Qlora4b DPO Parameters and Internals

LLM NameQlora4b DPO
Repository πŸ€—https://huggingface.co/syr99/qlora4b_dpo 
Model Size1.6b
Required VRAM2.5 GB
Updated2025-05-26
Maintainersyr99
Model Typephi
Model Files  2.5 GB
Model ArchitecturePhiForCausalLM
Context Length2048
Model Max Length2048
Transformers Version4.41.1
Tokenizer ClassCodeGenTokenizer
Padding Token<pad><pad><pad>
Vocabulary Size50296
Torch Data Typefloat32

Best Alternatives to Qlora4b DPO

Best Alternatives
Context / RAM
Downloads
Likes
Qlora4b Phi2K / 2.5 GB140
...reamtobenlpsama Mcqa Quantized2K / 1.8 GB60
Phi 2 Voicechange2K / 2.5 GB60
Test Model2K / 2.8 GB00
...hin 2 6 Phi 2 Bnb 4bit Smashed0K / 1.9 GB60
Note: green Score (e.g. "73.2") means that the model is better than syr99/qlora4b_dpo.