Pythia 12B Sft V8 Rlhf 2K Steps by OpenAssistant

 ยป  All LLMs  ยป  OpenAssistant  ยป  Pythia 12B Sft V8 Rlhf 2K Steps   URL Share it on

  Autotrain compatible   Endpoints compatible   Gpt neox   Pytorch   Region:us   Sharded

Pythia 12B Sft V8 Rlhf 2K Steps Benchmarks

๐ŸŒŸ Advertise your project ๐Ÿš€

Pythia 12B Sft V8 Rlhf 2K Steps Parameters and Internals

LLM NamePythia 12B Sft V8 Rlhf 2K Steps
Repository ๐Ÿค—https://huggingface.co/OpenAssistant/pythia-12b-sft-v8-rlhf-2k-steps 
Model Size12b
Required VRAM23.8 GB
Updated2025-06-11
MaintainerOpenAssistant
Model Typegpt_neox
Model Files  10.0 GB: 1-of-3   9.9 GB: 2-of-3   3.9 GB: 3-of-3
Model ArchitectureGPTNeoXForCausalLM
Licenseapache-2.0
Context Length2048
Model Max Length2048
Transformers Version4.28.1
Tokenizer ClassGPTNeoXTokenizer
Vocabulary Size50282
Torch Data Typefloat16
Pythia 12B Sft V8 Rlhf 2K Steps (OpenAssistant/pythia-12b-sft-v8-rlhf-2k-steps)

Best Alternatives to Pythia 12B Sft V8 Rlhf 2K Steps

Best Alternatives
Context / RAM
Downloads
Likes
Dolly V2 12B2K / 23.8 GB28681954
Pythia 12B2K / 23.8 GB38722137
...sst Sft 4 Pythia 12B Epoch 3.52K / 23.8 GB4804367
Oasst Sft 1 Pythia 12B2K / 23.8 GB2035277
Pythia 12B Deduped2K / 23.8 GB835851
Pythia 12B Sft V8 7K Steps2K / 23.8 GB117621
H2ogpt Oasst1 512 12B2K / 23.9 GB118327
Pythia 12B Pre V8.12.5K Steps2K / 23.8 GB2446
H2ogpt Gm Oasst1 En 1024 12B2K / 23.8 GB2495
Pythia 12B Sft V8.2.5K Steps2K / 23.8 GB2390
Note: green Score (e.g. "73.2") means that the model is better than OpenAssistant/pythia-12b-sft-v8-rlhf-2k-steps.

Rank the Pythia 12B Sft V8 Rlhf 2K Steps Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 48104 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241124