LLM EXPLORER 57,252 MODELS INDEXED

OLMo 7B by allenai

By allenai · 2343 downloads
HF Repo ↗ Copy URL

OLMo 7B is an open-source language model by allenai. Features: 7b LLM, VRAM: 27.6GB, License: apache-2.0, LLM Explorer Score: 0.14.

  Arxiv:2302.13971   Arxiv:2402.00838   Custom code   Dataset:allenai/dolma   En   Hf olmo   Pytorch   Region:us   Safetensors
Model Card on HF 🤗: https://huggingface.co/allenai/OLMo-7B 

OLMo 7B Parameters and Internals

Model Type 
Transformer style autoregressive language model
Use Cases 
Areas:
research, commercial applications
Limitations:
easy to prompt models to generate harmful content, bias, many facts may not be true
Additional Notes 
OLMo models are available with open training and evaluation code.
Supported Languages 
English (NLP)
Training Details 
Data Sources:
allenai/dolma
Data Volume:
2.5 Trillion Tokens for OLMo 7B
Context Length:
2048
Hardware Used:
MI250X GPUs at the LUMI supercomputer, A100-40GB GPUs provided by MosaicML
Model Architecture:
OLMo 7B architecture with peer models for comparison: d_model 4096, num heads 32, num layers 32, activation SwiGLU
Input Output 
Input Format:
Text
Accepted Modalities:
text
Output Format:
Text generation
Release Notes 
Version:
1.0
Notes:
Core OLMo 7B release with model details, performance, and usage guidelines.
LLM NameOLMo 7B
Repository 🤗https://huggingface.co/allenai/OLMo-7B 
Model Size7b
Required VRAM27.6 GB
Updated2026-08-07
Maintainerallenai
Model Typehf_olmo
Model Files  27.6 GB   27.6 GB
Supported Languagesen
Model ArchitectureOLMoForCausalLM
Licenseapache-2.0
Transformers Version4.36.2
Tokenizer ClassOLMoTokenizer
Padding Token<|padding|>
Vocabulary Size50280

Best Alternatives to OLMo 7B

Best Alternatives
Context / RAM
Downloads
Likes
OLMo 7B Instruct0K / 13.7 GB47553
OLMo 7B 04240K / 27.6 GB10851
OLMo 1.7 7B0K / 27.6 GB4643
OLMo 7B Twin 2T0K / 27.6 GB65122
OLMo 7B SFT0K / 13.7 GB334
Note: green Score (e.g. "73.2") means that the model is better than allenai/OLMo-7B.