LLM EXPLORER 67,390 MODELS INDEXED

OLMo 3.1 32B Think GPTQ Int4 16bit Output by TOWIN-AI

By TOWIN-AI · 68 downloads

OLMo 3.1 32B Think GPTQ Int4 16bit Output is an open-source language model by TOWIN-AI. Features: 32b LLM, VRAM: 18.1GB, Context: 64K, License: apache-2.0, Quantized, ELO: 1285.

  16bit   Code   Compressed-tensors   Conversational   Dataset:openai/gsm8k   En   Es   Gptq   Int4   Olmo   Olmo3   Quantized   Reasoning   Region:us   Safetensors   Think   Towin-ia   Tybsi   Vllm

OLMo 3.1 32B Think GPTQ Int4 16bit Output Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").

OLMo 3.1 32B Think GPTQ Int4 16bit Output Parameters and Internals

LLM NameOLMo 3.1 32B Think GPTQ Int4 16bit Output
Repository πŸ€—https://huggingface.co/TOWIN-AI/OLMo-3.1-32B-Think-GPTQ-Int4-16bit-output 
Base Model(s)  allenai/OLMo-3.1-32B-Think   allenai/OLMo-3.1-32B-Think
Model Size32b
Required VRAM18.1 GB
Updated2026-11-14
MaintainerTOWIN-AI
Model Typeolmo3
Model Files  18.1 GB
Supported Languageses en code
GPTQ QuantizationYes
Quantization Typegptq|16bit
Model ArchitectureOlmo3ForCausalLM
Licenseapache-2.0
Context Length65536
Model Max Length65536
Transformers Version4.57.1
Tokenizer ClassTokenizersBackend
Padding Token<|pad|>
Vocabulary Size100278

Best Alternatives to OLMo 3.1 32B Think GPTQ Int4 16bit Output

Best Alternatives
Context / RAM
Downloads
Likes
Olmo3 32B Gptq64K / 18.1 GB651
Olmo 3 32B Think64K / 64.7 GB7242172
Olmo 3.1 32B Think64K / 64.7 GB6248111
Olmo 3.1 32B Instruct64K / 64.7 GB7252
Olmo 3.1 32B Think64K / 64.7 GB161
... 3.1 32B Instruct MPOA Heretic64K / 64.8 GB5110
...o 3.1 32B Instruct ARA Heretic64K / 64.8 GB5100
...o 3.1 32B Instruct DiM Heretic64K / 64.8 GB4970
...3.1 32B Instruct GMPOA Heretic64K / 64.8 GB4870
...o 3.1 32B Instruct SOM Heretic64K / 64.8 GB4810
Note: green Score (e.g. "73.2") means that the model is better than TOWIN-AI/OLMo-3.1-32B-Think-GPTQ-Int4-16bit-output.