Midnight Rose 70B V2.0.3 By sophosympatheia: Benchmarks, Features and Detailed Analysis. Insights on Midnight Rose 70B V2.0.3.

Arxiv:2307.11760 Autotrain compatible En Endpoints compatible Llama Model-index Region:us Safetensors Sharded Tensorflow

Model Card on HF 🤗: https://huggingface.co/sophosympatheia/Midnight-Rose-70B-v2.0.3

Midnight Rose 70B V2.0.3 Benchmarks

ARC: 70.65 vs 96.7 (so35)^-26.9%

HellaSwag: 87.5 vs 95.3 (gpt4)^-8.2%

MMLU: 69.64 vs 88.3 (so35)^-21.1%

TruthfulQA: 65.27 vs 59 (gpt4)^10.6%

WinoGrande: 81.22 vs 87.5 (gpt4)^-7.2%

GSM8K: 28.35 vs 96.4 (so35)^-70.6%

LLME Score: 0.16581

^nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").

What is the LLM Explorer Rank (Score)

Midnight Rose 70B V2.0.3 (sophosympatheia/Midnight-Rose-70B-v2.0.3)

🌟 Advertise your project 🚀

Midnight Rose 70B V2.0.3 Parameters and Internals

LLM Name	Midnight Rose 70B V2.0.3
Repository 🤗	https://huggingface.co/sophosympatheia/Midnight-Rose-70B-v2.0.3
Model Size	70b
Required VRAM	138 GB
Updated	2025-09-21
Maintainer	sophosympatheia
Model Type	llama
Model Files	10.0 GB: 1-of-15 9.7 GB: 2-of-15 9.8 GB: 3-of-15 9.9 GB: 4-of-15 9.6 GB: 5-of-15 10.0 GB: 6-of-15 9.7 GB: 7-of-15 9.8 GB: 8-of-15 10.0 GB: 9-of-15 9.9 GB: 10-of-15 9.7 GB: 11-of-15 9.8 GB: 12-of-15 9.8 GB: 13-of-15 9.8 GB: 14-of-15 0.5 GB: 15-of-15
Supported Languages	en
Model Architecture	LlamaForCausalLM
License	llama2
Context Length	4096
Model Max Length	4096
Transformers Version	4.36.2
Tokenizer Class	LlamaTokenizer
Padding Token	<unk>
Vocabulary Size	32000
Torch Data Type	float16

Quantized Models of the Midnight Rose 70B V2.0.3

Model	Likes	Downloads	VRAM
Midnight Rose 70B V2.0.3 AWQ	0	8	36 GB
Midnight Rose 70B V2.0.3 GPTQ	1	9	35 GB
...t Rose 70B V2.0.3 3.75bpw EXL2	1	7	32 GB

Best Alternatives to Midnight Rose 70B V2.0.3

Best Alternatives	Context / RAM	Downloads	Likes
... Chat 1048K Chinese Llama3 70B	1024K / 141.9 GB	9761	5
... Chat 1048K Chinese Llama3 70B	1024K / 141.9 GB	9069	5
... 3 70B Instruct Gradient 1048K	1024K / 141.9 GB	12	122
Llama3 Function Calling 1048K	1024K / 141.9 GB	6	1
...a 3 70B Instruct Gradient 524K	512K / 141.9 GB	7	23
...a 3 70B Instruct Gradient 262K	256K / 141.9 GB	132	56
...ama 3 70B Arimas Story RP V2.0	256K / 141.1 GB	28	3
...ama 3 70B Arimas Story RP V1.6	256K / 141.2 GB	13	0
...ama 3 70B Arimas Story RP V1.5	256K / 141.2 GB	46	3
Yi 70B 200K RPMerge Franken	195K / 142.4 GB	6	1

Note: green Score (e.g. "73.2") means that the model is better than sophosympatheia/Midnight-Rose-70B-v2.0.3.

Rank the Midnight Rose 70B V2.0.3 Capabilities

🆘 Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! 🌟

Instruction Following and Task Automation
Factuality and Completeness of Knowledge
Censorship and Alignment
Data Analysis and Insight Generation
Text Generation
Text Summarization and Feature Extraction
Code Generation
Multi-Language Support and Translation

What open-source LLMs or SLMs are you in search of? 51507 in total.

Email us: info@extractum.io. Our Privacy Policy | Terms and Conditions | Suggest an improvement.

Our Social Media →

Original data from HuggingFace, OpenCompass and various public git repos.

Release v20241124

Support LLM Explorer