What are the hardware requirements for DPO?

DPO requires approximately 9.3 GB of VRAM. Quantized variants may run on less VRAM; see the Quantized Models section on this page.

Who developed DPO and how large is it?

DPO is developed by harshavaishnav, a model with 4b parameters. The model is published as open weights on Hugging Face and indexed on LLM Explorer with full benchmark history.

Where can I download or evaluate DPO?

DPO is hosted on Hugging Face and linked from this page. LLM Explorer also lists quantized variants and similar alternatives if available.

DPO by harshavaishnav — VRAM 9.3GB

Name: DPO
Author: harshavaishnav

DPO is an open-source language model by harshavaishnav. Features: 4b LLM, VRAM: 9.3GB, License: apache-2.0, LLM Explorer Score: 0.31.

Base model:adapter:qwen/qwen3.... Base model:qwen/qwen3.5-4b Conversational Dataset:harshavaishnav/dpo dat... Dpo En Lm-playschool Lora Playpen Qwen Qwen3 5 Region:us Safetensors Sharded Tensorflow

Model Card on HF 🤗: https://huggingface.co/harshavaishnav/DPO

DPO Benchmarks

LLME Score: 0.3117

^nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").

What is the LLM Explorer Rank (Score)

🌟 Advertise your project 🚀

DPO Parameters and Internals

LLM Name	DPO
Repository 🤗	https://huggingface.co/harshavaishnav/DPO
Model Name	Qwen/Qwen3.5-4B
Base Model(s)	Qwen/Qwen3.5-4B Qwen/Qwen3.5-4B
Model Size	4b
Required VRAM	9.3 GB
Updated	2026-07-07
Maintainer	harshavaishnav
Model Type	qwen3_5
Model Files	5.3 GB: 1-of-2 4.0 GB: 2-of-2
Supported Languages	en
Model Architecture	Qwen3_5ForConditionalGeneration
License	apache-2.0
Model Max Length	262144
Tokenizer Class	Qwen2Tokenizer
Padding Token	<\|endoftext\|>
Torch Data Type	bfloat16
Errors	replace

Best Alternatives to DPO

Best Alternatives	Context / RAM	Downloads	Likes
GRM 2.5	0K / 9.3 GB	4260	25
Qwopus3.5 4B V3	0K / 9.3 GB	1560	14
....6 Opus Reasoning Distilled V2	0K / 9.3 GB	1022	11
Qwen35 4B Plantdisease Cpt	0K / 9.1 GB	156	1
Qwen 3.5 4b QLORA Finetuning	0K / 9.3 GB	187	0
...e 4.6 Opus Reasoning Distilled	0K / 9.3 GB	241	31
Qwen3.5 4B Mlx Vlm Nvfp4	0K / 3 GB	84	0
Qwen3.5 4B MLX 4bit	0K / 3 GB	26299	24
Qwen3.5 4B OptiQ 4bit	0K / 0.1 GB	7823	23
Qwen3.5 4B Mlx 4bit	0K / 2.4 GB	16	3

Note: green Score (e.g. "73.2") means that the model is better than harshavaishnav/DPO.

Rank the DPO Capabilities

🆘 Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! 🌟

Instruction Following and Task Automation
Factuality and Completeness of Knowledge
Censorship and Alignment
Data Analysis and Insight Generation
Text Generation
Text Summarization and Feature Extraction
Code Generation
Multi-Language Support and Translation

What open-source LLMs or SLMs are you in search of? 54868 in total.

Email us: info@extractum.io. Our Privacy Policy | Terms and Conditions | Suggest an improvement.

Our Social Media →

Original data from HuggingFace, OpenCompass and various public git repos.

Check out Ag3ntum — our secure, self-hosted AI agent for server management.

Release v20260328a

Support LLM Explorer

DPO by harshavaishnav

» All LLMs » harshavaishnav » DPO URL Share it on

DPO Benchmarks

DPO Parameters and Internals

Best Alternatives to DPO

Rank the DPO Capabilities

What open-source LLMs or SLMs are you in search of? 54868 in total.