OLMo 7B Twin 2T Hf By allenai: Benchmarks, Features and Detailed Analysis. Insights on OLMo 7B Twin 2T Hf.

Arxiv:2302.13971 Arxiv:2402.00838 Autotrain compatible Dataset:allenai/dolma En Endpoints compatible Olmo Region:us Safetensors Sharded Tensorflow

Model Card on HF 🤗: https://huggingface.co/allenai/OLMo-7B-Twin-2T-hf

OLMo 7B Twin 2T Hf Benchmarks

LLME Score: 0.16587

^nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").

What is the LLM Explorer Rank (Score)

OLMo 7B Twin 2T Hf (allenai/OLMo-7B-Twin-2T-hf)

🌟 Advertise your project 🚀

OLMo 7B Twin 2T Hf Parameters and Internals

Model Type

Transformer style autoregressive language model

Supported Languages

English (NLP)

Training Details

Data Sources:

Dolma dataset

Data Volume:

2 Trillion tokens

Context Length:

2048

Hardware Used:

MI250X GPUs at the LUMI supercomputer, A100-40GB GPUs provided by MosaicML

Model Architecture:

SwiGLU activation, non-parametric LN LayerNorm type, RoPE pos embeddings, full attention variant

LLM Name	OLMo 7B Twin 2T Hf
Repository 🤗	https://huggingface.co/allenai/OLMo-7B-Twin-2T-hf
Model Size	7b
Required VRAM	27.6 GB
Updated	2025-09-23
Maintainer	allenai
Model Type	olmo
Model Files	4.9 GB: 1-of-6 5.0 GB: 2-of-6 4.9 GB: 3-of-6 4.9 GB: 4-of-6 4.9 GB: 5-of-6 3.0 GB: 6-of-6
Supported Languages	en
Model Architecture	OlmoForCausalLM
License	apache-2.0
Context Length	2048
Model Max Length	2048
Transformers Version	4.40.0.dev0
Tokenizer Class	GPTNeoXTokenizer
Padding Token	<\|padding\|>
Vocabulary Size	50304
Torch Data Type	float32

Best Alternatives to OLMo 7B Twin 2T Hf

Best Alternatives	Context / RAM	Downloads	Likes
OLMo 1.7 7B Hf	4K / 27.6 GB	26379	8
OLMo 7B 0724 Hf	4K / 27.6 GB	8287	15
OLMo 7B 0724 Instruct Hf	4K / 13.8 GB	1269	6
OLMo 7B 0424 Hf	4K / 27.6 GB	2458	14
OLMo 7B Hf	2K / 27.6 GB	3109	15
OLMo 7B Instruct Hf	2K / 27.6 GB	1690	6
OLMo 7B SFT Hf	2K / 27.6 GB	3756	1
OLMo 7B 0724 SFT Hf	2K / 13.8 GB	1902	4
Olmo 7B Hf Step0	2K / 27.6 GB	6	0
OLMo 7B Instruct Hf	2K / 27.6 GB	74	3

Note: green Score (e.g. "73.2") means that the model is better than allenai/OLMo-7B-Twin-2T-hf.

Rank the OLMo 7B Twin 2T Hf Capabilities

🆘 Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! 🌟

Instruction Following and Task Automation
Factuality and Completeness of Knowledge
Censorship and Alignment
Data Analysis and Insight Generation
Text Generation
Text Summarization and Feature Extraction
Code Generation
Multi-Language Support and Translation

What open-source LLMs or SLMs are you in search of? 51544 in total.

Email us: info@extractum.io. Our Privacy Policy | Terms and Conditions | Suggest an improvement.

Our Social Media →

Original data from HuggingFace, OpenCompass and various public git repos.

Release v20241124

Support LLM Explorer

OLMo 7B Twin 2T Hf by allenai

» All LLMs » allenai » OLMo 7B Twin 2T Hf URL Share it on

OLMo 7B Twin 2T Hf Benchmarks

OLMo 7B Twin 2T Hf Parameters and Internals

Best Alternatives to OLMo 7B Twin 2T Hf

Rank the OLMo 7B Twin 2T Hf Capabilities

What open-source LLMs or SLMs are you in search of? 51544 in total.