What are the hardware requirements for Deepseek Llm 67B Base?

Deepseek Llm 67B Base requires approximately 135 GB of VRAM and supports a context window of 4K tokens. Quantized variants may run on less VRAM; see the Quantized Models section on this page.

Who developed Deepseek Llm 67B Base and how large is it?

Deepseek Llm 67B Base is developed by deepseek-ai, a model with 67b parameters. The model is published as open weights on Hugging Face and indexed on LLM Explorer with full benchmark history.

How does Deepseek Llm 67B Base perform on standard benchmarks?

Deepseek Llm 67B Base has the following published scores: MMLU 71.9. Compare against reference models on this page or on the LLM Explorer leaderboards.

Deepseek Llm 67B Base by deepseek-ai — VRAM 135GB, 4K context

Name: Deepseek Llm 67B Base
Author: deepseek-ai

Deepseek Llm 67B Base is an open-source language model by deepseek-ai. Features: 67b LLM, VRAM: 135GB, Context: 4K, License: other, LLM Explorer Score: 0.16, Arc: 93.7, HellaSwag: 82.3, MMLU: 71.9, GSM8K: 66.5.

Deploy:azure Endpoints compatible Llama Pytorch Region:us Sharded

Model Card on HF 🤗: https://huggingface.co/deepseek-ai/deepseek-llm-67b-base

Deepseek Llm 67B Base Benchmarks

ARC: 93.7 vs 96.7 (so35)^-3.1%

HellaSwag: 82.3 vs 95.3 (gpt4)^-13.6%

MMLU: 71.9 vs 88.3 (so35)^-18.6%

GSM8K: 66.5 vs 96.4 (so35)^-31%

OpenCompas: 61.3 vs 73.3 (gpt4)^-16.4%

Exam: 75.1 vs 77.2 (gpt4)^-2.7%

Language: 45.4 vs 62 (gpt4)^-26.8%

Knowledge: 64.1 vs 73.5 (gpt4)^-12.8%

Understand: 70.5 vs 70 (gpt4)^0.7%

Reasoning: 57.9 vs 74.4 (gpt4)^-22.2%

LLME Score: 0.16354

^nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").

What is the LLM Explorer Rank (Score)

Deepseek Llm 67B Base (deepseek-ai/deepseek-llm-67b-base)

🌟 Advertise your project 🚀

Deepseek Llm 67B Base Parameters and Internals

Model Type

text generation

Additional Notes

DeepSeek LLM is open source for the research community.

Supported Languages

English (Proficient), Chinese (Proficient)

Training Details

Data Volume:

2 trillion tokens

Model Architecture:

Grouped-Query Attention

LLM Name	Deepseek Llm 67B Base
Repository 🤗	https://huggingface.co/deepseek-ai/deepseek-llm-67b-base
Model Size	67b
Required VRAM	135 GB
Updated	2026-04-15
Maintainer	deepseek-ai
Model Type	llama
Model Files	10.0 GB: 1-of-14 10.0 GB: 2-of-14 9.7 GB: 3-of-14 9.7 GB: 4-of-14 9.7 GB: 5-of-14 9.7 GB: 6-of-14 9.7 GB: 7-of-14 9.7 GB: 8-of-14 9.7 GB: 9-of-14 9.7 GB: 10-of-14 9.7 GB: 11-of-14 9.7 GB: 12-of-14 9.7 GB: 13-of-14 8.3 GB: 14-of-14
Model Architecture	LlamaForCausalLM
License	other
Context Length	4096
Model Max Length	4096
Transformers Version	4.33.1
Tokenizer Class	LlamaTokenizerFast
Beginning of Sentence Token	<｜begin▁of▁sentence｜>
End of Sentence Token	<｜end▁of▁sentence｜>
Vocabulary Size	102400
Torch Data Type	bfloat16

Quantized Models of the Deepseek Llm 67B Base

Model	Likes	Downloads	VRAM
Deepseek Llm 67B Base GGUF	3	366	28 GB
Deepseek Llm 67B Base AWQ	2	32	37 GB
Deepseek Llm 67B Base GPTQ	1	9	36 GB

Best Alternatives to Deepseek Llm 67B Base

Best Alternatives	Context / RAM	Downloads	Likes
Deepseek Llm 67B Chat	4K / 135 GB	2295	206
...penbuddy Deepseek 67B V18.1 4K	4K / 135 GB	8182	1
Openbuddy Deepseek 67B V15.2	4K / 135 GB	1905	10
...penbuddy Deepseek 67B V15.3 4K	4K / 135 GB	6	1
Openbuddy Deepseek 67B V15.1	4K / 135 GB	562	1
...penbuddy Deepseek 67B V15 Base	4K / 135 GB	126	0
...penbuddy Deepseek 67B V15.3 4K	4K / 135 GB	5	1
Deepmoney 67B Chat	4K / 135 GB	18	23
DeepSeek 67B MMIQC	4K / 135 GB	9	1
...67B Spicy 3.1 1 5.0bpw H6 EXL2	4K / 43.7 GB	4	1

Note: green Score (e.g. "73.2") means that the model is better than deepseek-ai/deepseek-llm-67b-base.

Rank the Deepseek Llm 67B Base Capabilities

🆘 Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! 🌟

Instruction Following and Task Automation
Factuality and Completeness of Knowledge
Censorship and Alignment
Data Analysis and Insight Generation
Text Generation
Text Summarization and Feature Extraction
Code Generation
Multi-Language Support and Translation

What open-source LLMs or SLMs are you in search of? 54415 in total.

Email us: info@extractum.io. Our Privacy Policy | Terms and Conditions | Suggest an improvement.

Our Social Media →

Original data from HuggingFace, OpenCompass and various public git repos.

Check out Ag3ntum — our secure, self-hosted AI agent for server management.

Release v20260328a

Support LLM Explorer

Deepseek Llm 67B Base by deepseek-ai