LLM EXPLORER 61,491 MODELS INDEXED

OctoThinker 8B Long Base by OctoThinker

By OctoThinker · 1291 downloads
HF Repo ↗ Copy URL

OctoThinker 8B Long Base is an open-source language model by OctoThinker. Features: 3b LLM, VRAM: 16.1GB, Context: 128K, License: llama3.2, LLM Explorer Score: 0.19.

  Arxiv:2506.20512 Base model:finetune:meta-llama... Base model:meta-llama/llama-3....   Dataset:llm360/megamath Dataset:octothinker/megamath-w...   En   Llama   Region:us   Safetensors   Sharded   Tensorflow
Model Card on HF 🤗: https://huggingface.co/OctoThinker/OctoThinker-8B-Long-Base 

OctoThinker 8B Long Base Parameters and Internals

LLM NameOctoThinker 8B Long Base
Repository 🤗https://huggingface.co/OctoThinker/OctoThinker-8B-Long-Base 
Base Model(s)  meta-llama/Llama-3.2-3B   meta-llama/Llama-3.2-3B
Model Size3b
Required VRAM16.1 GB
Updated2026-09-17
MaintainerOctoThinker
Model Typellama
Model Files  5.0 GB: 1-of-4   5.0 GB: 2-of-4   4.9 GB: 3-of-4   1.2 GB: 4-of-4
Supported Languagesen
Model ArchitectureLlamaForCausalLM
Licensellama3.2
Context Length131072
Model Max Length131072
Transformers Version4.51.3
Tokenizer ClassPreTrainedTokenizer
Vocabulary Size128256
Torch Data Typebfloat16

Best Alternatives to OctoThinker 8B Long Base

Best Alternatives
Context / RAM
Downloads
Likes
Nanbeige4.1 3B256K / 7.9 GB208751161
Nanbeige4.1 3B Heretic256K / 7.9 GB14950
Nanbeige4.1 3B Heretic Mxfp4256K / 7.9 GB342
Nanbeige4.1 3B Bf16256K / 7.9 GB473
...anbeige4.1 3B Heretic Bfloat16256K / 7.9 GB331
Nanbeige4.1 3B Heretic256K / 7.9 GB141
Nanbeige4.1 3B Heretic256K / 7.9 GB150
ISA 03 Mini 3B Hybrid Preview256K / 6.5 GB44
ToolMind Web 3B192K / 7.9 GB15628
Llama 3.2 3B Instruct128K / 6.5 GB18295722368
Note: green Score (e.g. "73.2") means that the model is better than OctoThinker/OctoThinker-8B-Long-Base.