What are the hardware requirements for GPT Oss 20B GGUF?

GPT Oss 20B GGUF requires approximately 11.5 GB of VRAM and supports a context window of 128K tokens. Quantized variants may run on less VRAM; see the Quantized Models section on this page.

Who developed GPT Oss 20B GGUF and how large is it?

GPT Oss 20B GGUF is developed by unsloth, a model with 20b parameters. The model is published as open weights on Hugging Face and indexed on LLM Explorer with full benchmark history.

Where can I download or evaluate GPT Oss 20B GGUF?

GPT Oss 20B GGUF is hosted on Hugging Face and linked from this page. LLM Explorer also lists quantized variants and similar alternatives if available.

GPT Oss 20B GGUF by unsloth — VRAM 11.5GB, 128K context

Name: GPT Oss 20B GGUF
Author: unsloth

GPT Oss 20B GGUF is an open-source language model by unsloth. Features: 20b LLM, VRAM: 11.5GB, Context: 128K, License: apache-2.0, Quantized, LLM Explorer Score: 0.33.

Base model:openai/gpt-oss-20b Base model:quantized:openai/gp... Conversational Endpoints compatible Gguf Gpt oss Openai Q2 Quantized Region:us Unsloth

Model Card on HF 🤗: https://huggingface.co/unsloth/gpt-oss-20b-GGUF

GPT Oss 20B GGUF Parameters and Internals

LLM Name	GPT Oss 20B GGUF
Repository 🤗	https://huggingface.co/unsloth/gpt-oss-20b-GGUF
Base Model(s)	GPT Oss 20B openai/gpt-oss-20b
Model Size	20b
Required VRAM	11.5 GB
Updated	2026-07-11
Maintainer	unsloth
Model Type	gpt_oss
Model Files	13.8 GB 11.5 GB 11.8 GB 11.5 GB 11.5 GB 11.5 GB 11.6 GB 11.6 GB 11.6 GB 11.7 GB 11.7 GB 12.0 GB 12.1 GB 11.9 GB 12.0 GB 13.2 GB
GGUF Quantization	Yes
Quantization Type	gguf\|q2\|q4_k\|q5_k
Model Architecture	GptOssForCausalLM
License	apache-2.0
Context Length	131072
Model Max Length	131072
Transformers Version	4.55.0
Vocabulary Size	201088
Torch Data Type	bfloat16

Rank the GPT Oss 20B GGUF capabilities

Have you tried this model? Rate its performance — this feedback helps the ML community find the right model for their needs.

Instruction Following and Task Automation
Factuality and Completeness of Knowledge
Censorship and Alignment
Data Analysis and Insight Generation
Text Generation
Text Summarization and Feature Extraction
Code Generation
Multi-Language Support and Translation

Best Alternatives to GPT Oss 20B GGUF

Best Alternatives	Context / RAM	Downloads	Likes
GPT Oss 20B MXFP4 Q8	128K / 12.1 GB	397	2
GPT Oss 20B MXFP4 Q8	128K / 12.1 GB	354421	79
GPT Oss 20B OptiQ 4bit	128K / 11.6 GB	1690	6
GPT Oss 20B Unsloth Bnb 4bit	128K / 12.6 GB	64914	38
GPT Oss 20B 4bit	128K / 13.8 GB	18	1
...s 20B Ja Fin Thinking MLX 4bit	128K / 11.8 GB	126	1
...s 20B Ja Fin Thinking MLX 8bit	128K / 22.1 GB	102	1
GPT Oss 20B MLX 8bit	128K / 22.1 GB	2890	58
GPT Oss 20B MXFP4 Q4	128K / 11.2 GB	2178	16
GPT Oss 20B Bnb 4bit	128K / 40.8 GB	2402	14