LLM EXPLORER 64,442 MODELS INDEXED

Gemma 4 12B It FP8 Dynamic by axteam

By axteam · 35 downloads

Gemma 4 12B It FP8 Dynamic is an open-source language model by axteam. Features: 12b LLM, VRAM: 13GB, License: apache-2.0, LLM Explorer Score: 0.28.

Base model:google/gemma-4-12b-... Base model:quantized:google/ge...   Compressed-tensors   Conversational   Endpoints compatible   Fp8   Gemma   Gemma4   Gemma4 unified   Image-text-to-text   Quantized   Region:us   Safetensors   Vllm

Gemma 4 12B It FP8 Dynamic Parameters and Internals

LLM NameGemma 4 12B It FP8 Dynamic
Repository πŸ€—https://huggingface.co/axteam/gemma-4-12B-it-FP8-dynamic 
Base Model(s)  Gemma 4 12B It   google/gemma-4-12B-it
Model Size12b
Required VRAM13 GB
Updated2026-10-15
Maintaineraxteam
Model Typegemma4_unified
Model Files  13.0 GB
Model ArchitectureGemma4UnifiedForConditionalGeneration
Licenseapache-2.0
Transformers Version5.10.0.dev0
Tokenizer ClassGemmaTokenizer
Padding Token<pad>

Best Alternatives to Gemma 4 12B It FP8 Dynamic

Best Alternatives
Context / RAM
Downloads
Likes
Gemma 4 12B It0K / 23.9 GB29653961417
Gemma 4 12B0K / 23.9 GB82749779
...able5 Composer2.5 V2.3.5x Tau20K / 23.9 GB24241587
Jev Omni0K / 23.9 GB0223
Gemma 4 12B It NVFP40K / 9.3 GB4757920
Gemma 4 12B It0K / 23.9 GB14684315
...le5 Composer2.5 V1 Abliterated0K / 24 GB300031
Gemma 4 12B0K / 23.9 GB1302618
...2B It AEON Abliterated K4 BF160K / 23.9 GB695032
...a 4 12B It W4a16 Llmcompressor0K / 7.7 GB23701
Note: green Score (e.g. "73.2") means that the model is better than axteam/gemma-4-12B-it-FP8-dynamic.