LLM EXPLORER 59,420 MODELS INDEXED

Dolly V2 12B by databricks

By databricks · 3283 downloads

Dolly V2 12B is an open-source language model by databricks. Features: 12b LLM, VRAM: 23.8GB, Context: 2K, License: mit, LLM Explorer Score: 0.27, ELO: 982, Arc: 42.4, HellaSwag: 72.5, MMLU: 25.9, GSM8K: 1.2.

  Autotrain compatible Dataset:databricks/databricks-...   En   Gpt neox   Pytorch   Region:us

Dolly V2 12B Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").

Dolly V2 12B Parameters and Internals

Model Type 
causal language model
Use Cases 
Primary Use Cases:
instruction following
Limitations:
syntactically complex prompts, programming problems, mathematical operations, factual errors, dates and times, open-ended question answering, hallucination, enumerating lists of specific length, stylistic mimicry, humor, well-formatted letter writing
Training Details 
Data Sources:
EleutherAI Pythia, databricks-dolly-15k
Methodology:
Instruction fine-tuning
Model Architecture:
Derived from EleutherAI's Pythia-12b
Input Output 
Accepted Modalities:
text
Performance Tips:
Include `torch_dtype=torch.bfloat16` to reduce memory usage if supported. Use `trust_remote_code=True` when loading the pipeline.
LLM NameDolly V2 12B
Repository πŸ€—https://huggingface.co/databricks/dolly-v2-12b 
Model Size12b
Required VRAM23.8 GB
Updated2025-09-23
Maintainerdatabricks
Model Typegpt_neox
Model Files  23.8 GB
Supported Languagesen
Model ArchitectureGPTNeoXForCausalLM
Licensemit
Context Length2048
Model Max Length2048
Transformers Version4.25.1
Tokenizer ClassGPTNeoXTokenizer
Vocabulary Size50280
Torch Data Typebfloat16

Best Alternatives to Dolly V2 12B

Best Alternatives
Context / RAM
Downloads
Likes
...sst Sft 4 Pythia 12B Epoch 3.52K / 23.8 GB818368
Pythia 12B2K / 23.8 GB147000145
Oasst Rl 1 Pythia 12B2K / 23.8 GB104
...st Sft 3 Pythia 12B Epoch 2.352K / 23.8 GB100
Pythia 12B Deduped2K / 23.8 GB417253
Oasst Sft 1 Pythia 12B2K / 23.8 GB301277
Pythia 12B Sft V8 7K Steps2K / 23.8 GB110622
Oasst Pythia 12B Reference2K / 23.8 GB14420
H2ogpt Oasst1 512 12B2K / 23.9 GB24229
Pythia 12B Pre V8.12.5K Steps2K / 23.8 GB766