What are the hardware requirements for Gemma 2B Orpo?

Gemma 2B Orpo requires approximately 5.1 GB of VRAM and supports a context window of 8K tokens. Quantized variants may run on less VRAM; see the Quantized Models section on this page.

Who developed Gemma 2B Orpo and how large is it?

Gemma 2B Orpo is developed by anakin87, a model with 2b parameters. The model is published as open weights on Hugging Face and indexed on LLM Explorer with full benchmark history.

How does Gemma 2B Orpo perform on standard benchmarks?

Gemma 2B Orpo has the following published scores: MMLU 38.52. Compare against reference models on this page or on the LLM Explorer leaderboards.

Gemma 2B Orpo by anakin87 — VRAM 5.1GB, 8K context

Name: Gemma 2B Orpo
Author: anakin87

Gemma 2B Orpo is an open-source language model by anakin87. Features: 2b LLM, VRAM: 5.1GB, Context: 8K, License: other, LLM Explorer Score: 0.17, Arc: 49.2, HellaSwag: 73.7, MMLU: 38.5, GSM8K: 13.9.

Arxiv:2403.07691 Base model:finetune:google/gem... Base model:google/gemma-2b Conversational Dataset:alvarobartt/dpo-mix-7k... En Endpoints compatible Gemma Generated from trainer Model-index Orpo Region:us Safetensors Sharded Tensorflow Trl

Model Card on HF 🤗: https://huggingface.co/anakin87/gemma-2b-orpo

Gemma 2B Orpo Parameters and Internals

Model Type

text-generation

Use Cases

Areas:

text generation

Additional Notes

The model is optimized to run smoothly on platforms such as Colab. It supports ORPO, which offers efficient training and memory usage benefits.

Supported Languages

en (English)

Training Details

Data Sources:

alvarobartt/dpo-mix-7k-simplified

Methodology:

The model uses ORPO (Odds Ratio Preference Optimization), integrating supervised fine-tuning and preference alignment phases.

LLM Name	Gemma 2B Orpo
Repository 🤗	https://huggingface.co/anakin87/gemma-2b-orpo
Base Model(s)	Gemma 2B google/gemma-2b
Model Size	2b
Required VRAM	5.1 GB
Updated	2026-08-07
Maintainer	anakin87
Model Type	gemma
Model Files	5.0 GB: 1-of-2 0.1 GB: 2-of-2 0.0 GB
Supported Languages	en
Model Architecture	GemmaForCausalLM
License	other
Context Length	8192
Model Max Length	8192
Transformers Version	4.39.1
Tokenizer Class	GemmaTokenizer
Padding Token	<pad>
Vocabulary Size	256000
Torch Data Type	bfloat16

Rank the Gemma 2B Orpo capabilities

Have you tried this model? Rate its performance — this feedback helps the ML community find the right model for their needs.

Instruction Following and Task Automation
Factuality and Completeness of Knowledge
Censorship and Alignment
Data Analysis and Insight Generation
Text Generation
Text Summarization and Feature Extraction
Code Generation
Multi-Language Support and Translation

Best Alternatives to Gemma 2B Orpo

Best Alternatives	Context / RAM	Downloads	Likes
Gemma 1.1 2B It	8K / 5.1 GB	209209	173
Gemma 2B It	8K / 5 GB	16802	3
Gemma 1.1 2B It	8K / 5 GB	43	3
Gemma 2B It Peru Legal Es V2	8K / 5.1 GB	8	1
Codegemma 2B	8K / 5.1 GB	33091	101
Gita SastraGPT V1	8K / 5.1 GB	4	1
Caca Tinny 2B V3	8K / 5.1 GB	4	1
Pandas Tutor Gemma 2B	8K / 5.1 GB	6	1
Gemma Qlora Customer Support	8K / 5.1 GB	8	0
... 2B Finetuned Sft Navarasa 2.0	8K / 10 GB	536	27

Note: green Score (e.g. "73.2") means that the model is better than anakin87/gemma-2b-orpo.