What are the hardware requirements for Gemma 2 27B Bnb 4bit?

Gemma 2 27B Bnb 4bit requires approximately 15.8 GB of VRAM and supports a context window of 8K tokens. Quantized variants may run on less VRAM; see the Quantized Models section on this page.

Who developed Gemma 2 27B Bnb 4bit and how large is it?

Gemma 2 27B Bnb 4bit is developed by unsloth, a model with 27b parameters. The model is published as open weights on Hugging Face and indexed on LLM Explorer with full benchmark history.

Where can I download or evaluate Gemma 2 27B Bnb 4bit?

Gemma 2 27B Bnb 4bit is hosted on Hugging Face and linked from this page. LLM Explorer also lists quantized variants and similar alternatives if available.

Gemma 2 27B Bnb 4bit by unsloth — VRAM 15.8GB, 8K context

Name: Gemma 2 27B Bnb 4bit
Author: unsloth

Gemma 2 27B Bnb 4bit is an open-source language model by unsloth. Features: 27b LLM, VRAM: 15.8GB, Context: 8K, License: gemma, Quantized, LLM Explorer Score: 0.14.

4-bit 4bit Bitsandbytes En Endpoints compatible Gemma Gemma2 Quantized Region:us Safetensors Sharded Tensorflow Unsloth

Model Card on HF 🤗: https://huggingface.co/unsloth/gemma-2-27b-bnb-4bit

Gemma 2 27B Bnb 4bit Benchmarks

LLME Score: 0.14485

^nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").

What is the LLM Explorer Rank (Score)

Gemma 2 27B Bnb 4bit (unsloth/gemma-2-27b-bnb-4bit)

🌟 Advertise your project 🚀

Gemma 2 27B Bnb 4bit Parameters and Internals

Model Type

text generation

Use Cases

Areas:

research, commercial applications

Applications:

finetuning models

Primary Use Cases:

finetuning to improve performance or reduce memory usage

Input Output

Accepted Modalities:

text

Performance Tips:

Using the Unsoth method allows for faster processing and reduced memory usage.

LLM Name	Gemma 2 27B Bnb 4bit
Repository 🤗	https://huggingface.co/unsloth/gemma-2-27b-bnb-4bit
Model Size	27b
Required VRAM	15.8 GB
Updated	2026-04-15
Maintainer	unsloth
Model Type	gemma2
Model Files	7.9 GB: 1-of-2 7.9 GB: 2-of-2
Supported Languages	en
Quantization Type	4bit
Model Architecture	Gemma2ForCausalLM
License	gemma
Context Length	8192
Model Max Length	8192
Transformers Version	4.44.2
Tokenizer Class	GemmaTokenizer
Padding Token	<pad>
Vocabulary Size	256000
Torch Data Type	bfloat16

Quantized Models of the Gemma 2 27B Bnb 4bit

Model	Likes	Downloads	VRAM
GEMMA2 27B NLI 16bit	0	5	54 GB

Best Alternatives to Gemma 2 27B Bnb 4bit

Best Alternatives	Context / RAM	Downloads	Likes
Gemma 2 27B 4bit	8K / 15.3 GB	38	0
Gemma 2 27B 8bit	8K / 28.8 GB	29	2
Gemma 2 27B It Bnb 4bit	8K / 15.8 GB	12068	11
Gemma2 Mixed Therapy Ft	8K / 15.8 GB	4	2
GEMMA2 27B NLI 16bit	8K / 54.7 GB	5	0
Gemma 2 27B It 4bit	8K / 15.3 GB	231	8
Gemma 2 27B It 8bit	8K / 28.8 GB	170	10
Gemma 2 27B It 4bit	8K / 15.8 GB	7	3
ATOMIS	32K / 66 GB	9	5
SystemGemma2 27B It	32K / 54.7 GB	96	1

Note: green Score (e.g. "73.2") means that the model is better than unsloth/gemma-2-27b-bnb-4bit.

Rank the Gemma 2 27B Bnb 4bit Capabilities

🆘 Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! 🌟

Instruction Following and Task Automation
Factuality and Completeness of Knowledge
Censorship and Alignment
Data Analysis and Insight Generation
Text Generation
Text Summarization and Feature Extraction
Code Generation
Multi-Language Support and Translation

What open-source LLMs or SLMs are you in search of? 53373 in total.

Email us: info@extractum.io. Our Privacy Policy | Terms and Conditions | Suggest an improvement.

Our Social Media →

Original data from HuggingFace, OpenCompass and various public git repos.

Check out Ag3ntum — our secure, self-hosted AI agent for server management.

Release v20260328a

Support LLM Explorer

Gemma 2 27B Bnb 4bit by unsloth