LLM EXPLORER 61,135 MODELS INDEXED

Gemma 2 27B It FP8 by nm-testing

By nm-testing · 17 downloads

Gemma 2 27B It FP8 is an open-source language model by nm-testing. Features: 27b LLM, VRAM: 28.3GB, Context: 8K, LLM Explorer Score: 0.13.

  Autotrain compatible   Conversational   Endpoints compatible   Fp8   Gemma2   Region:us   Safetensors   Sharded   Tensorflow

Gemma 2 27B It FP8 Parameters and Internals

LLM NameGemma 2 27B It FP8
Repository πŸ€—https://huggingface.co/nm-testing/gemma-2-27b-it-FP8 
Model Size27b
Required VRAM28.3 GB
Updated2025-09-23
Maintainernm-testing
Model Typegemma2
Model Files  4.8 GB: 1-of-6   4.9 GB: 2-of-6   4.9 GB: 3-of-6   4.9 GB: 4-of-6   4.9 GB: 5-of-6   3.9 GB: 6-of-6
Model ArchitectureGemma2ForCausalLM
Context Length8192
Model Max Length8192
Transformers Version4.42.1
Tokenizer ClassGemmaTokenizer
Padding Token<pad>
Vocabulary Size256000
Torch Data Typebfloat16

Quantized Models of the Gemma 2 27B It FP8

Model
Likes
Downloads
VRAM
Gemma 2 27B It 8bit1015228 GB

Best Alternatives to Gemma 2 27B It FP8

Best Alternatives
Context / RAM
Downloads
Likes
ATOMIS32K / 66 GB78
SystemGemma2 27B It32K / 54.7 GB961
SystemGemma2 27B It32K / 54.7 GB113
Gemma 2 27B It8K / 54.7 GB117753568
Gemma 2 27B It8K / 54.7 GB521666
...izon AI Korean Avengers V3 27B8K / 54.8 GB80
...izon AI Korean Avengers V2 27B8K / 54.8 GB80
Gemma2Slerp2 27B8K / 54.8 GB141
...s Horizon AI Korean Superb 27B8K / 54.8 GB82
GemmaStock1 27B8K / 54.8 GB80
Note: green Score (e.g. "73.2") means that the model is better than nm-testing/gemma-2-27b-it-FP8.