Pythia 12B Pre V8.12.5K Steps is an open-source language model by OpenAssistant. Features: 12b LLM, VRAM: 23.8GB, Context: 2K, License: apache-2.0, LLM Explorer Score: 0.1, Arc: 41.5, HellaSwag: 68.8, MMLU: 26.6, GSM8K: 7.7.
Pythia 12B Pre V8.12.5K Steps Parameters and Internals
Model Type Additional Notes This is an intermediate model used as a base for further experiments, not intended for use.
Training Details
Data Sources: gpteacher_roleplay, red_pajama, wizardlm_70k, joke, poem_instructions, oa_stackexchange, tell_a_joke, webgpt, gpt4all, alpaca_gpt4, code_alpaca, vicuna, oig_file, minimath, humaneval_mbpp_codegen_qa, humaneval_mbpp_testgen_qa, grade_school_math_instructions, recipes, cmu_wiki_qa, oa_wiki_qa_bart_10000row, prosocial_dialogue, explain_prosocial, soda, oa_leet10k, dolly15k
Data Volume: 12.5k steps with batch-size 128
Methodology: Context Length: Model Architecture:
Rank the Pythia 12B Pre V8.12.5K Steps capabilities
Have you tried this model? Rate its performance — this feedback helps the ML community find the right model for their needs.
Instruction Following and Task Automation
Factuality and Completeness of Knowledge
Censorship and Alignment
Data Analysis and Insight Generation
Text Generation
Text Summarization and Feature Extraction
Code Generation
Multi-Language Support and Translation
Best Alternatives to Pythia 12B Pre V8.12.5K Steps
Note: green Score (e.g. "73.2 ") means that the model is better than OpenAssistant/pythia-12b-pre-v8-12.5k-steps .
Expand