LLM EXPLORER 59,358 MODELS INDEXED

Gemma 2 27B It SimPO 37K 100steps by AALF

By AALF · 34 downloads

Gemma 2 27B It SimPO 37K 100steps is an open-source language model by AALF. Features: 27b LLM, VRAM: 54.7GB, Context: 8K, License: gemma, LLM Explorer Score: 0.17.

  Arxiv:2310.01377   Arxiv:2405.14734   Alignment-handbook Base model:finetune:google/gem... Base model:google/gemma-2-27b-...   Conversational   Deploy:azure   Endpoints compatible   Gemma2   Generated from trainer   Region:us   Safetensors   Sharded   Tensorflow

Gemma 2 27B It SimPO 37K 100steps Parameters and Internals

Model Type 
text-generation
Training Details 
Data Sources:
HuggingFaceH4/ultrafeedback_binarized
Data Volume:
37,040 training data points
Methodology:
SimPO framework with On-Policy Preference Data Generation
Context Length:
2048
Hardware Used:
8x80G A800 GPUs
Input Output 
Input Format:
Prompts with max length of 1800
Accepted Modalities:
text
Output Format:
Text
LLM NameGemma 2 27B It SimPO 37K 100steps
Repository πŸ€—https://huggingface.co/AALF/gemma-2-27b-it-SimPO-37K-100steps 
Base Model(s)  Gemma 2 27B It   google/gemma-2-27b-it
Model Size27b
Required VRAM54.7 GB
Updated2026-08-24
MaintainerAALF
Model Typegemma2
Model Files  4.7 GB: 1-of-12   4.9 GB: 2-of-12   4.9 GB: 3-of-12   5.0 GB: 4-of-12   4.9 GB: 5-of-12   4.9 GB: 6-of-12   5.0 GB: 7-of-12   4.9 GB: 8-of-12   4.9 GB: 9-of-12   5.0 GB: 10-of-12   4.9 GB: 11-of-12   0.7 GB: 12-of-12
Model ArchitectureGemma2ForCausalLM
Licensegemma
Context Length8192
Model Max Length8192
Transformers Version4.43.3
Tokenizer ClassGemmaTokenizer
Padding Token<pad>
Vocabulary Size256000
Torch Data Typebfloat16

Best Alternatives to Gemma 2 27B It SimPO 37K 100steps

Best Alternatives
Context / RAM
Downloads
Likes
ATOMIS32K / 66 GB78
SystemGemma2 27B It32K / 54.7 GB961
SystemGemma2 27B It32K / 54.7 GB113
Gemma 2 27B It8K / 54.7 GB117753568
Gemma 2 27B It8K / 54.7 GB521666
...izon AI Korean Avengers V3 27B8K / 54.8 GB80
...izon AI Korean Avengers V2 27B8K / 54.8 GB80
Gemma2Slerp2 27B8K / 54.8 GB141
...s Horizon AI Korean Superb 27B8K / 54.8 GB82
GemmaStock1 27B8K / 54.8 GB80
Note: green Score (e.g. "73.2") means that the model is better than AALF/gemma-2-27b-it-SimPO-37K-100steps.