LLM EXPLORER
 LLM Explorer: A Curated Large Language Model Directory and Analytics
Dark Theme
  LLM  List    LLM Hosting    LLM Leaderboards    Blog    Newsfeed    Advertise

Einstein V6.1 Llama3 8B by Weyaxi

 »  All LLMs  »  Weyaxi  »  Einstein V6.1 Llama3 8B   URL Share it on

  7120   
  Autotrain compatible   Axolotl Base model:finetune:meta-llama... Base model:meta-llama/meta-lla...   Biology   Chatml   Chemistry   Conversational   Dataset:allenai/ai2 arc   Dataset:allenai/wildchat   Dataset:bigbio/med qa   Dataset:camel-ai/biology   Dataset:camel-ai/chemistry   Dataset:camel-ai/math   Dataset:camel-ai/physics Dataset:cot-alpaca-gpt4-from-o...   Dataset:derek-thomas/scienceqa Dataset:huggingfaceh4/no robot... Dataset:jondurbin/airoboros-3.... Dataset:knowrohit07/saraswati-...   Dataset:ldjnr/capybara   Dataset:lmsys/lmsys-chat-1m Dataset:m-a-p/codefeedback-fil...   Dataset:mandyyyyii/scibench Dataset:meta-math/metamathqa-4...   Dataset:metaeval/reclor Dataset:microsoft/orca-math-wo... Dataset:migtissera/synthia-v1....   Dataset:open-orca/slimorca Dataset:openassistant/oasst to...   Dataset:openbookqa Dataset:openchat/openchat shar...   Dataset:piqa   Dataset:sablo/oasst2 curated   Dataset:scibench   Dataset:sciq Dataset:stem-ai-mtl/electrical... Dataset:teknium/gpteacher-gene...   Dataset:tiger-lab/mathinstruct   Dataset:tiger-lab/scienceeval Dataset:totally-not-an-llm/eve... Dataset:wizardlm/wizardlm evol...   En   Endpoints compatible   Finetuned   Generated from trainer   Gpt4   Instruct   Llama   Llama3   Math   Model-index   Physics   Region:us   Safetensors   Science   Sharded   Synthetic data   Tensorflow
Model Card on HF 🤗: https://huggingface.co/Weyaxi/Einstein-v6.1-Llama3-8B 

Einstein V6.1 Llama3 8B Benchmarks

MMLU Pro: 23.68
GPQA: 4.25
MUSR: 11.23
BBH: 29.38
IFEval: 45.68 vs 88 (so35)-48.1%
ARC: 62.46 vs 96.7 (so35)-35.4%
HellaSwag: 82.41 vs 95.3 (gpt4)-13.5%
MMLU: 66.19 vs 88.3 (so35)-25%
TruthfulQA: 55.1 vs 59 (gpt4)-6.6%
WinoGrande: 79.32 vs 87.5 (gpt4)-9.3%
GSM8K: 66.11 vs 96.4 (so35)-31.4%
MATH Lvl 5: 6.8
LLME Score: 0.28173
nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
🌟 Advertise your project 🚀

Einstein V6.1 Llama3 8B Parameters and Internals

Model Type 
text-generation
Additional Notes 
The model is based on Llama3 with fine-tuning on a variety of datasets focusing on sciences and text-based instructions.
Supported Languages 
English (fluent)
Training Details 
Data Sources:
allenai/ai2_arc, camel-ai/physics, camel-ai/chemistry, camel-ai/biology, camel-ai/math, metaeval/reclor, openbookqa, mandyyyyii/scibench, derek-thomas/ScienceQA, TIGER-Lab/ScienceEval, jondurbin/airoboros-3.2, LDJnr/Capybara, Cot-Alpaca-GPT4-From-OpenHermes-2.5, STEM-AI-mtl/Electrical-engineering, knowrohit07/saraswati-stem, sablo/oasst2_curated, lmsys/lmsys-chat-1m, TIGER-Lab/MathInstruct, bigbio/med_qa, meta-math/MetaMathQA-40K, piqa, allenai/WildChat, microsoft/orca-math-word-problems-200k, openchat/openchat_sharegpt4_dataset, teknium/GPTeacher-General-Instruct, m-a-p/CodeFeedback-Filtered-Instruction, totally-not-an-llm/EverythingLM-data-V3, HuggingFaceH4/no_robots, OpenAssistant/oasst_top1_2023-08-25, WizardLM/WizardLM_evol_instruct_70k
Data Volume:
unknown
Methodology:
Fine-tuning on diverse datasets
Context Length:
8192
Training Time:
unknown
Hardware Used:
8xRTX3090, 1xRTXA6000
Model Architecture:
Meta-Llama-3
Input Output 
Input Format:
ChatML
Accepted Modalities:
text
Output Format:
Text
LLM NameEinstein V6.1 Llama3 8B
Repository 🤗https://huggingface.co/Weyaxi/Einstein-v6.1-Llama3-8B 
Base Model(s)  Meta Llama 3 8B   meta-llama/Meta-Llama-3-8B
Model Size8b
Required VRAM16.1 GB
Updated2025-06-11
MaintainerWeyaxi
Model Typellama
Instruction-BasedYes
Model Files  5.0 GB: 1-of-4   5.0 GB: 2-of-4   4.9 GB: 3-of-4   1.2 GB: 4-of-4   0.0 GB
Supported Languagesen
Model ArchitectureLlamaForCausalLM
Licenseother
Context Length8192
Model Max Length8192
Transformers Version4.40.0.dev0
Tokenizer ClassPreTrainedTokenizerFast
Padding Token<|end_of_text|>
Vocabulary Size128260
Torch Data Typebfloat16
Einstein V6.1 Llama3 8B (Weyaxi/Einstein-v6.1-Llama3-8B)

Quantized Models of the Einstein V6.1 Llama3 8B

Model
Likes
Downloads
VRAM
Einstein V6.1 Llama3 8B AWQ4165 GB

Best Alternatives to Einstein V6.1 Llama3 8B

Best Alternatives
Context / RAM
Downloads
Likes
...otron 8B UltraLong 4M Instruct4192K / 32.1 GB3715108
UltraLong Thinking4192K / 16.1 GB8292
...a 3.1 8B UltraLong 4M Instruct4192K / 32.1 GB17624
...otron 8B UltraLong 2M Instruct2096K / 32.1 GB92315
...a 3.1 8B UltraLong 2M Instruct2096K / 32.1 GB8759
Zero Llama 3.1 8B Beta61048K / 16.1 GB14161
...otron 8B UltraLong 1M Instruct1048K / 32.1 GB207045
...a 3.1 8B UltraLong 1M Instruct1048K / 32.1 GB138729
....1 1million Ctx Dark Planet 8B1048K / 32.3 GB952
...dger Nu Llama 3.1 8B UltraLong1048K / 16.2 GB133
Note: green Score (e.g. "73.2") means that the model is better than Weyaxi/Einstein-v6.1-Llama3-8B.

Rank the Einstein V6.1 Llama3 8B Capabilities

🆘 Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! 🌟

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 48079 in total.

Email us: info@extractum.io. Our Privacy Policy  | Terms and Conditions  | Suggest an improvement.
Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241124
  Support LLM Explorer