Gemma 4 31B It GGUF by unsloth

 »  All LLMs  »  unsloth  »  Gemma 4 31B It GGUF   URL Share it on

Gemma 4 31B It GGUF is an open-source language model by unsloth. Features: 31b LLM, VRAM: 1.2GB, License: apache-2.0, Quantized, LLM Explorer Score: 0.64, ELO: 1452.

Base model:google/gemma-4-31b-... Base model:quantized:google/ge...   Conversational   Endpoints compatible   Gemma   Gemma4   Gguf   Google   Image-text-to-text   Imatrix   Q3   Quantized   Region:us   Unsloth

Gemma 4 31B It GGUF Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").

Gemma 4 31B It GGUF Parameters and Internals

LLM NameGemma 4 31B It GGUF
Repository 🤗https://huggingface.co/unsloth/gemma-4-31B-it-GGUF 
Base Model(s)  Gemma 4 31B It   google/gemma-4-31B-it
Model Size31b
Required VRAM1.2 GB
Updated2026-05-29
Maintainerunsloth
Model Typegemma4
Model Files  17.3 GB   16.4 GB   14.7 GB   13.2 GB   17.3 GB   19.1 GB   18.3 GB   17.4 GB   21.7 GB   21.1 GB   25.2 GB   32.6 GB   10.8 GB   8.5 GB   11.8 GB   11.8 GB   15.4 GB   18.8 GB   21.9 GB   27.5 GB   35.0 GB   1.2 GB   1.2 GB   2.3 GB
GGUF QuantizationYes
Quantization Typegguf|q3|q4_k|q5_k
Model ArchitectureGemma4ForConditionalGeneration
Licenseapache-2.0
Transformers Version5.5.0.dev0
Torch Data Typebfloat16

Best Alternatives to Gemma 4 31B It GGUF

Best Alternatives
Context / RAM
Downloads
Likes
Gemma 4 31B It PolarQuant Q50K / 21.4 GB9823
Gemma 4 31B It Mlx 4bit0K / 18.5 GB4044
Gemma 4 31B It HLWQ Q50K / 21.4 GB124
Gemma 4 31B It0K / 62.6 GB107066252780
Gemma 4 31B IT NVFP40K / 32.6 GB2470042491
Gemma 4 31B It0K / 62.6 GB3276020
Equinox 31B0K / 62.6 GB50644
G4 MeroMero 31B0K / 62.6 GB232853
Gemma 4 31B It Abliterated0K / 62.5 GB812718
G4 31B Musica V10K / 62.5 GB207217
Note: green Score (e.g. "73.2") means that the model is better than unsloth/gemma-4-31B-it-GGUF.

Rank the Gemma 4 31B It GGUF Capabilities

🆘 Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! 🌟

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 54089 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Check out Ag3ntum — our secure, self-hosted AI agent for server management.
Release v20260328a