LLM Name | GPT Oss 120B 3bit |
Repository ๐ค | https://huggingface.co/NexVeridian/gpt-oss-120b-3bit |
Base Model(s) | |
Model Size | 120b |
Required VRAM | 51.4 GB |
Updated | 2025-09-23 |
Maintainer | NexVeridian |
Model Type | gpt_oss |
Model Files | |
Quantization Type | 3bit |
Model Architecture | GptOssForCausalLM |
License | apache-2.0 |
Context Length | 131072 |
Model Max Length | 131072 |
Transformers Version | 4.55.0.dev0 |
Tokenizer Class | PreTrainedTokenizerFast |
Padding Token | <|endoftext|> |
Vocabulary Size | 201088 |
Best Alternatives |
Context / RAM |
Downloads |
Likes |
---|---|---|---|
GPT Oss 120B MLX 8bit | 128K / 123.7 GB | 82225 | 10 |
GPT Oss 120B Unsloth Bnb 4bit | 128K / 62.1 GB | 9992 | 8 |
GPT Oss 120B MXFP4 Q4 | 128K / 61.9 GB | 1251 | 4 |
GPT Oss 120B MXFP4 Q8 | 128K / 63.7 GB | 1215 | 3 |
GPT Oss 120B 4bit | 128K / 65.9 GB | 140 | 4 |
GPT Oss 120B | 128K / 65.1 GB | 3627546 | 3872 |
GPT Oss 120B GGUF | 128K / 65.4 GB | 106105 | 143 |
GPT Oss 120B | 128K / 65.1 GB | 93463 | 12 |
GPT Oss 120B BF16 | 128K / 142 GB | 5346 | 3 |
GPT Oss 120B Dequantized | 128K / 135.6 GB | 6014 | 0 |
๐ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐