What are the hardware requirements for Dolly V2 7B Sharded?

Dolly V2 7B Sharded requires approximately 27.7 GB of VRAM and supports a context window of 2K tokens. Quantized variants may run on less VRAM; see the Quantized Models section on this page.

Who developed Dolly V2 7B Sharded and how large is it?

Dolly V2 7B Sharded is developed by ethzanalytics, a model with 7b parameters. The model is published as open weights on Hugging Face and indexed on LLM Explorer with full benchmark history.

Where can I download or evaluate Dolly V2 7B Sharded?

Dolly V2 7B Sharded is hosted on Hugging Face and linked from this page. LLM Explorer also lists quantized variants and similar alternatives if available.

Dolly V2 7B Sharded by ethzanalytics — VRAM 27.7GB, 2K context

Name: Dolly V2 7B Sharded
Author: ethzanalytics

Dolly V2 7B Sharded is an open-source language model by ethzanalytics. Features: 7b LLM, VRAM: 27.7GB, Context: 2K, License: mit, LLM Explorer Score: 0.06.

Dataset:databricks/databricks-... Dolly Dolly-v2 En Endpoints compatible Gpt neox Instruct Pytorch Region:us Sharded

Model Card on HF 🤗: https://huggingface.co/ethzanalytics/dolly-v2-7b-sharded

Dolly V2 7B Sharded Parameters and Internals

Model Type

text generation

Additional Notes

Sharded checkpoint enables low-RAM loading, suitable for environments like Colab.

Supported Languages

en (English)

Input Output

Accepted Modalities:

text

LLM Name	Dolly V2 7B Sharded
Repository 🤗	https://huggingface.co/ethzanalytics/dolly-v2-7b-sharded
Model Size	7b
Required VRAM	27.7 GB
Updated	2026-05-29
Maintainer	ethzanalytics
Model Type	gpt_neox
Model Files	3.8 GB: 1-of-8 3.8 GB: 2-of-8 4.0 GB: 3-of-8 3.9 GB: 4-of-8 3.8 GB: 5-of-8 3.8 GB: 6-of-8 3.8 GB: 7-of-8 0.8 GB: 8-of-8
Supported Languages	en
Model Architecture	GPTNeoXForCausalLM
License	mit
Context Length	2048
Model Max Length	2048
Transformers Version	4.28.1
Tokenizer Class	GPTNeoXTokenizer
Vocabulary Size	50280
Torch Data Type	float32

Rank the Dolly V2 7B Sharded capabilities

Have you tried this model? Rate its performance — this feedback helps the ML community find the right model for their needs.

Instruction Following and Task Automation
Factuality and Completeness of Knowledge
Censorship and Alignment
Data Analysis and Insight Generation
Text Generation
Text Summarization and Feature Extraction
Code Generation
Multi-Language Support and Translation

Quantized Models of the Dolly V2 7B Sharded

Model	Likes	Downloads	VRAM
Dolly V2 7B Sharded 8bit	1	9	7 GB

Best Alternatives to Dolly V2 7B Sharded

Best Alternatives	Context / RAM	Downloads	Likes
Literature 7B 16384	16K / 36 GB	9	16
RedPajama 7B 16384	16K / 36 GB	8	4
Stablelm Tuned Alpha 7B	4K / 31.9 GB	713	361
Stablelm Base Alpha 7B	4K / 31.9 GB	884	208
Stablelm 7B Sft V7 Epoch 3	4K / 32.4 GB	64	67
StableLManticore 7B	4K / 16 GB	10	1
Pythia 6.9B Deduped 4K	4K / 27.2 GB	8	10
Stablelm 7B	4K / 31.9 GB	7	2
Dolly V2 7B	2K / 13.8 GB	1596	150
Open Calm 7B	2K / 13.9 GB	523	205

Note: green Score (e.g. "73.2") means that the model is better than ethzanalytics/dolly-v2-7b-sharded.