LLM EXPLORER 59,358 MODELS INDEXED

Qwen2.5 0.5B SFT 2e 5 2ep MDPO 5e 7 2ep 0alp 0lam by JayHyeon

By JayHyeon · 8 downloads
HF Repo ↗ Copy URL

Qwen2.5 0.5B SFT 2e 5 2ep MDPO 5e 7 2ep 0alp 0lam is an open-source language model by JayHyeon. Features: 0.5b LLM, VRAM: 2GB, Context: 32K, LLM Explorer Score: 0.18.

  Arxiv:1910.09700   Endpoints compatible   Feature-extraction   Qwen2   Region:us   Safetensors   Text-embeddings-inference
Model Card on HF 🤗: https://huggingface.co/JayHyeon/Qwen2.5-0.5B-SFT-2e-5-2ep-MDPO_5e-7_2ep_0alp_0lam 

Qwen2.5 0.5B SFT 2e 5 2ep MDPO 5e 7 2ep 0alp 0lam Parameters and Internals

LLM NameQwen2.5 0.5B SFT 2e 5 2ep MDPO 5e 7 2ep 0alp 0lam
Repository 🤗https://huggingface.co/JayHyeon/Qwen2.5-0.5B-SFT-2e-5-2ep-MDPO_5e-7_2ep_0alp_0lam 
Model Size0.5b
Required VRAM2 GB
Updated2026-07-22
MaintainerJayHyeon
Model Typeqwen2
Model Files  2.0 GB
Model ArchitectureQwen2Model
Context Length32768
Model Max Length32768
Transformers Version4.47.0.dev0
Tokenizer ClassQwen2Tokenizer
Padding Token<|endoftext|>
Vocabulary Size151936
Torch Data Typefloat32
Errorsreplace

Best Alternatives to Qwen2.5 0.5B SFT 2e 5 2ep MDPO 5e 7 2ep 0alp 0lam

Best Alternatives
Context / RAM
Downloads
Likes
... 5 2ep IRPO 1e 7 1ep 1alp 0lam32K / 2 GB60
...e 5 2ep DPO 1e 7 2ep 0alp 0lam32K / 2 GB70
... 5 2ep DPOP 5e 6 1ep 0alp 5lam32K / 2 GB90
...5B Instruct SFT IRPO 1epoch V132K / 2 GB70
....5B Instruct SFT DPO 1epoch V132K / 2 GB220
... 5 2ep IRPO 1e 7 2ep 1alp 0lam32K / 2 GB60
... 5 2ep MDPO 1e 6 2ep 0alp 0lam32K / 2 GB140
... 5 2ep MDPO 1e 6 1ep 0alp 0lam32K / 2 GB80
...e 5 2ep DPO 2e 6 2ep 0alp 0lam32K / 2 GB50
... 5 2ep IRPO 5e 7 1ep 1alp 0lam32K / 2 GB50
Note: green Score (e.g. "73.2") means that the model is better than JayHyeon/Qwen2.5-0.5B-SFT-2e-5-2ep-MDPO_5e-7_2ep_0alp_0lam.