What are the hardware requirements for Gemma 2B Bnb 4bit?

Gemma 2B Bnb 4bit requires approximately 2.1 GB of VRAM and supports a context window of 8K tokens. Quantized variants may run on less VRAM; see the Quantized Models section on this page.

Who developed Gemma 2B Bnb 4bit and how large is it?

Gemma 2B Bnb 4bit is developed by unsloth, a model with 2b parameters. The model is published as open weights on Hugging Face and indexed on LLM Explorer with full benchmark history.

Where can I download or evaluate Gemma 2B Bnb 4bit?

Gemma 2B Bnb 4bit is hosted on Hugging Face and linked from this page. LLM Explorer also lists quantized variants and similar alternatives if available.

Gemma 2B Bnb 4bit by unsloth — VRAM 2.1GB, 8K context

Name: Gemma 2B Bnb 4bit
Author: unsloth

Gemma 2B Bnb 4bit is an open-source language model by unsloth. Features: 2b LLM, VRAM: 2.1GB, Context: 8K, License: apache-2.0, Quantized, LLM Explorer Score: 0.15.

4-bit 4bit Bitsandbytes Bnb En Endpoints compatible Gemma Gemma-2b Quantized Region:us Safetensors Unsloth

Model Card on HF 🤗: https://huggingface.co/unsloth/gemma-2b-bnb-4bit

Gemma 2B Bnb 4bit Benchmarks

LLME Score: 0.14844

^nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").

What is the LLM Explorer Rank (Score)

Gemma 2B Bnb 4bit (unsloth/gemma-2b-bnb-4bit)

🌟 Advertise your project 🚀

Gemma 2B Bnb 4bit Parameters and Internals

Model Type

transformers

Additional Notes

Fine-tuning models can be done using Google Colab notebooks for free.

Input Output

Accepted Modalities:

text

LLM Name	Gemma 2B Bnb 4bit
Repository 🤗	https://huggingface.co/unsloth/gemma-2b-bnb-4bit
Model Size	2b
Required VRAM	2.1 GB
Updated	2026-05-19
Maintainer	unsloth
Model Type	gemma
Model Files	2.1 GB
Supported Languages	en
Quantization Type	4bit
Model Architecture	GemmaForCausalLM
License	apache-2.0
Context Length	8192
Model Max Length	8192
Transformers Version	4.44.2
Tokenizer Class	GemmaTokenizer
Padding Token	<pad>
Vocabulary Size	256000
Torch Data Type	bfloat16

Quantized Models of the Gemma 2B Bnb 4bit

Model	Likes	Downloads	VRAM
... 2B It Hermes Function Calling	0	5	5 GB
Gemma Help Tiny Sft	1	37	5 GB
Jenna Gemma V01 Gguf 8bit	1	105	2 GB
Emo AI 3B	1	5	5 GB
Jenna Gemma V01 Gguf Q4	0	22	1 GB
Jenna Gemma V01 Gguf 16bit	0	8	5 GB
Test Model	0	5	2 GB
PRIME DeCyphers Final	1	5	5 GB
Mode Gemma	0	58	2 GB
Gemma 2B Malayalam Merged	1	2	5 GB

Best Alternatives to Gemma 2B Bnb 4bit

Best Alternatives	Context / RAM	Downloads	Likes
... 2B It Hermes Function Calling	8K / 5.1 GB	5	0
Gemma 2B It Bnb 4bit	8K / 2.1 GB	6354	20
Vi Gemma 2B RAG	8K / 5.1 GB	72	13
My AwesomeFinance Model	8K / 2.1 GB	5	0
... 2.8 Gemma 2B HQQ 1bit Smashed	8K / 1.3 GB	5	0
... 2.8 Gemma 2B HQQ 2bit Smashed	8K / 1.6 GB	5	0
... 2.8 Gemma 2B HQQ 4bit Smashed	8K / 2.1 GB	5	0
Emo AI 3B	8K / 5.1 GB	5	1
Jenna V3 QGemma 2B	8K / 5.1 GB	6	0
Gemma 2B Sentiment	8K / 5.1 GB	13	0

Note: green Score (e.g. "73.2") means that the model is better than unsloth/gemma-2b-bnb-4bit.

Rank the Gemma 2B Bnb 4bit Capabilities

🆘 Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! 🌟

Instruction Following and Task Automation
Factuality and Completeness of Knowledge
Censorship and Alignment
Data Analysis and Insight Generation
Text Generation
Text Summarization and Feature Extraction
Code Generation
Multi-Language Support and Translation

What open-source LLMs or SLMs are you in search of? 53972 in total.

Email us: info@extractum.io. Our Privacy Policy | Terms and Conditions | Suggest an improvement.

Our Social Media →

Original data from HuggingFace, OpenCompass and various public git repos.

Check out Ag3ntum — our secure, self-hosted AI agent for server management.

Release v20260328a

Support LLM Explorer

Gemma 2B Bnb 4bit by unsloth