Galactica 30B Evol Instruct 70K By GeorgiaTechResearchInstitute: Benchmarks, Features and Detailed Analysis. Insights on Galactica 30B Evol Instruct 70K.

Arxiv:2304.12244 Alpaca Autotrain compatible Dataset:wizardlm/wizardlm evol... Galactica Instruct Opt Region:us Safetensors Sharded Tensorflow Wizardlm

Model Card on HF 🤗: https://huggingface.co/GeorgiaTechResearchInstitute/galactica-30b-evol-instruct-70k

Galactica 30B Evol Instruct 70K Benchmarks

LLME Score: 0.10967

^nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").

What is the LLM Explorer Rank (Score)

Galactica 30B Evol Instruct 70K (GeorgiaTechResearchInstitute/galactica-30b-evol-instruct-70k)

🌟 Advertise your project 🚀

Galactica 30B Evol Instruct 70K Parameters and Internals

Model Type

text generation

Use Cases

Areas:

scientific research

Primary Use Cases:

language model in scientific domain

Limitations:

potential to produce inaccurate information

Considerations:

Caution against production use without safeguards.

Additional Notes

Model is designed for scientific tasks.

Training Details

Data Sources:

scientific corpus, open-access scientific text, Evol-Instruct-70k dataset

Data Volume:

106 billion tokens

Methodology:

Fine-tuning using Evol-Instruct framework

Context Length:

1024

Training Time:

196 hours

Hardware Used:

16 A100 80GB GPUs

Input Output

Input Format:

Instruction-response

Accepted Modalities:

text

Output Format:

Text

LLM Name	Galactica 30B Evol Instruct 70K
Repository 🤗	https://huggingface.co/GeorgiaTechResearchInstitute/galactica-30b-evol-instruct-70k
Model Size	30b
Required VRAM	60.1 GB
Updated	2025-08-18
Maintainer	GeorgiaTechResearchInstitute
Model Type	opt
Instruction-Based	Yes
Model Files	9.8 GB: 1-of-7 9.9 GB: 2-of-7 9.9 GB: 3-of-7 9.9 GB: 4-of-7 9.9 GB: 5-of-7 9.9 GB: 6-of-7 0.8 GB: 7-of-7
Model Architecture	OPTForCausalLM
License	cc-by-nc-4.0
Context Length	2048
Model Max Length	2048
Transformers Version	4.29.2
Tokenizer Class	PreTrainedTokenizerFast
Vocabulary Size	50000
Torch Data Type	bfloat16
Activation Function	gelu

Quantized Models of the Galactica 30B Evol Instruct 70K

Model	Likes	Downloads	VRAM
...ica 30B Evol Instruct 70K GPTQ	11	17	16 GB

Best Alternatives to Galactica 30B Evol Instruct 70K

Best Alternatives	Context / RAM	Downloads	Likes
...ica 30B Evol Instruct 70K GPTQ	2K / 16.3 GB	17	11

Rank the Galactica 30B Evol Instruct 70K Capabilities

🆘 Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! 🌟

Instruction Following and Task Automation
Factuality and Completeness of Knowledge
Censorship and Alignment
Data Analysis and Insight Generation
Text Generation
Text Summarization and Feature Extraction
Code Generation
Multi-Language Support and Translation

What open-source LLMs or SLMs are you in search of? 50729 in total.

Email us: info@extractum.io. Our Privacy Policy | Terms and Conditions | Suggest an improvement.

Our Social Media →

Original data from HuggingFace, OpenCompass and various public git repos.

Release v20241124

Support LLM Explorer