LLM Name | GPT Oss 20B MXFP4 Q4 |
Repository ๐ค | https://huggingface.co/mlx-community/gpt-oss-20b-MXFP4-Q4 |
Base Model(s) | |
Model Size | 20b |
Required VRAM | 11.2 GB |
Updated | 2025-09-05 |
Maintainer | mlx-community |
Model Type | gpt_oss |
Model Files | |
Quantization Type | q4 |
Model Architecture | GptOssForCausalLM |
License | apache-2.0 |
Context Length | 131072 |
Model Max Length | 131072 |
Transformers Version | 4.55.0.dev0 |
Tokenizer Class | PreTrainedTokenizer |
Padding Token | <|endoftext|> |
Vocabulary Size | 201088 |
Best Alternatives |
Context / RAM |
Downloads |
Likes |
---|---|---|---|
GPT Oss 20B MLX 8bit | 128K / 22.1 GB | 1696451 | 36 |
GPT Oss 20B MXFP4 Q8 | 128K / 12.1 GB | 166393 | 5 |
GPT Oss 20B Unsloth Bnb 4bit | 128K / 12.6 GB | 165589 | 23 |
GPT Oss 20B Bnb 4bit | 128K / 40.8 GB | 56362 | 12 |
GPT Oss Coder 20B | 128K / 13.8 GB | 155 | 6 |
GPT Oss 20B | 128K / 13.8 GB | 9535741 | 3420 |
GPT Oss 20B GGUF | 128K / 11.5 GB | 605609 | 364 |
GPT Oss 20B | 128K / 13.8 GB | 52728 | 28 |
GPT Oss 20B BF16 | 128K / 41.6 GB | 47288 | 19 |
GPT Oss 20B Dequantized | 128K / 41.6 GB | 4980 | 0 |
๐ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐