What are the hardware requirements for OLMo 1.7 7B?

OLMo 1.7 7B requires approximately 27.6 GB of VRAM. Quantized variants may run on less VRAM; see the Quantized Models section on this page.

Who developed OLMo 1.7 7B and how large is it?

OLMo 1.7 7B is developed by allenai, a model with 7b parameters. The model is published as open weights on Hugging Face and indexed on LLM Explorer with full benchmark history.

Where can I download or evaluate OLMo 1.7 7B?

OLMo 1.7 7B is hosted on Hugging Face and linked from this page. LLM Explorer also lists quantized variants and similar alternatives if available.

OLMo 1.7 7B by allenai — VRAM 27.6GB

Name: OLMo 1.7 7B
Author: allenai

OLMo 1.7 7B is an open-source language model by allenai. Features: 7b LLM, VRAM: 27.6GB, License: apache-2.0, LLM Explorer Score: 0.12.

Arxiv:2402.00838 Autotrain compatible Dataset:allenai/dolma En Endpoints compatible Olmo Pytorch Region:us

Model Card on HF 🤗: https://huggingface.co/allenai/OLMo-1.7-7B

OLMo 1.7 7B Parameters and Internals

Model Type

Transformer, autoregressive language model

Additional Notes

Model includes QKV clipping enhancing performance.

Supported Languages

en (English)

Training Details

Data Sources:

Dolma 1.7 dataset

Data Volume:

approx. 2.05 Trillion tokens

Methodology:

Two-stage curriculum with staged training and annealing

Context Length:

4096

Hardware Used:

Databricks, Kempner Institute for the Study of Natural and Artificial Intelligence at Harvard University, AMD, CSC (Lumi Supercomputer), UW

Model Architecture:

Transformer

LLM Name	OLMo 1.7 7B
Repository 🤗	https://huggingface.co/allenai/OLMo-1.7-7B
Model Size	7b
Required VRAM	27.6 GB
Updated	2024-07-30
Maintainer	allenai
Model Type	olmo
Model Files	27.6 GB
Supported Languages	en
Model Architecture	OLMoForCausalLM
License	apache-2.0
Transformers Version	4.39.3
Tokenizer Class	OLMoTokenizer
Padding Token	<\|padding\|>
Vocabulary Size	50280

Rank the OLMo 1.7 7B capabilities

Have you tried this model? Rate its performance — this feedback helps the ML community find the right model for their needs.

Instruction Following and Task Automation
Factuality and Completeness of Knowledge
Censorship and Alignment
Data Analysis and Insight Generation
Text Generation
Text Summarization and Feature Extraction
Code Generation
Multi-Language Support and Translation

Best Alternatives to OLMo 1.7 7B

Best Alternatives	Context / RAM	Downloads	Likes
OLMo 7B Instruct	0K / 13.7 GB	475	53
OLMo 7B	0K / 27.6 GB	2343	653
OLMo 7B 0424	0K / 27.6 GB	108	51
OLMo 7B Twin 2T	0K / 27.6 GB	651	22
OLMo 7B SFT	0K / 13.7 GB	33	4

Note: green Score (e.g. "73.2") means that the model is better than allenai/OLMo-1.7-7B.