LLM EXPLORER 60,783 MODELS INDEXED

Dense 1B 130B by allenai

By allenai · 415 downloads

Dense 1B 130B is an open-source language model by allenai. Features: 1b LLM, VRAM: 6GB, Context: 4K, License: other, LLM Explorer Score: 0.25.

  Arxiv:2605.06663   Ablation   Baseline   Conversational   Custom code   Dataset:allenai/olmoe-mix-0924   Dense   En   Memory-matched   Olmo2 noqknorm prenorm   Region:us   Safetensors   Sharded   Tensorflow
Model Card on HF πŸ€—: https://huggingface.co/allenai/Dense_1b_130B 

Dense 1B 130B Parameters and Internals

LLM NameDense 1b 130B
Repository πŸ€—https://huggingface.co/allenai/Dense_1b_130B 
Model Size1b
Required VRAM6 GB
Updated2026-06-04
Maintainerallenai
Model Typeolmo2_noqknorm_prenorm
Model Files  5.0 GB: 1-of-2   1.0 GB: 2-of-2
Supported Languagesen
Model ArchitectureOlmo2NoQKNormPrenormForCausalLM
Licenseother
Context Length4096
Model Max Length4096
Transformers Version4.57.1
Tokenizer ClassGPT2Tokenizer
Padding Token<|pad|>
Vocabulary Size100352