Gemma 4 31B It GGUF by unsloth

 »  All LLMs  »  unsloth  »  Gemma 4 31B It GGUF   URL Share it on

Gemma 4 31B It GGUF is an open-source language model by unsloth. Features: 31b LLM, VRAM: 1.2GB, License: apache-2.0, Quantized, LLM Explorer Score: 0.64, ELO: 1452.

Base model:google/gemma-4-31b-... Base model:quantized:google/ge...   Conversational   Endpoints compatible   Gemma   Gemma4   Gguf   Google   Image-text-to-text   Imatrix   Q3   Quantized   Region:us   Unsloth

Gemma 4 31B It GGUF Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").

Gemma 4 31B It GGUF Parameters and Internals

LLM NameGemma 4 31B It GGUF
Repository 🤗https://huggingface.co/unsloth/gemma-4-31B-it-GGUF 
Base Model(s)  Gemma 4 31B It   google/gemma-4-31B-it
Model Size31b
Required VRAM1.2 GB
Updated2026-06-10
Maintainerunsloth
Model Typegemma4
Model Files  17.3 GB   16.4 GB   14.7 GB   13.2 GB   17.3 GB   19.1 GB   18.3 GB   17.4 GB   21.7 GB   21.1 GB   25.2 GB   32.6 GB   10.8 GB   8.5 GB   11.8 GB   11.8 GB   15.4 GB   18.8 GB   21.9 GB   27.5 GB   35.0 GB   1.2 GB   1.2 GB   2.3 GB
GGUF QuantizationYes
Quantization Typegguf|q3|q4_k|q5_k
Model ArchitectureGemma4ForConditionalGeneration
Licenseapache-2.0
Transformers Version5.5.0.dev0
Torch Data Typebfloat16

Best Alternatives to Gemma 4 31B It GGUF

Best Alternatives
Context / RAM
Downloads
Likes
...emma 4 31B It Unsloth Bnb 4bit0K / 19.2 GB58403818
Gemma 4 31B It PolarQuant Q50K / 21.4 GB9823
Gemma 4 31B It Mlx 4bit0K / 18.5 GB2264
Gemma 4 31B It HLWQ Q50K / 21.4 GB84
Gemma 4 31B It0K / 62.6 GB107066252780
Gemma 4 31B IT NVFP40K / 32.6 GB2456814501
Gemma 4 31B It0K / 62.6 GB3180920
G4 MeroMero 31B0K / 62.6 GB346755
Equinox 31B0K / 62.6 GB50644
Gemma 4 31B It Heretic0K / 62.5 GB1266151
Note: green Score (e.g. "73.2") means that the model is better than unsloth/gemma-4-31B-it-GGUF.

Rank the Gemma 4 31B It GGUF Capabilities

🆘 Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! 🌟

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 54415 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Check out Ag3ntum — our secure, self-hosted AI agent for server management.
Release v20260328a