What are the hardware requirements for Internlm2 Base 20B Llama?

Internlm2 Base 20B Llama requires approximately 39.6 GB of VRAM and supports a context window of 32K tokens. Quantized variants may run on less VRAM; see the Quantized Models section on this page.

Who developed Internlm2 Base 20B Llama and how large is it?

Internlm2 Base 20B Llama is developed by intervitens, a model with 20b parameters. The model is published as open weights on Hugging Face and indexed on LLM Explorer with full benchmark history.

How does Internlm2 Base 20B Llama perform on standard benchmarks?

Internlm2 Base 20B Llama has the following published scores: MMLU 63.78. Compare against reference models on this page or on the LLM Explorer leaderboards.

Internlm2 Base 20B Llama by intervitens — VRAM 39.6GB, 32K context

Name: Internlm2 Base 20B Llama
Author: intervitens

Internlm2 Base 20B Llama is an open-source language model by intervitens. Features: 20b LLM, VRAM: 39.6GB, Context: 32K, License: other, LLM Explorer Score: 0.12, Arc: 63, HellaSwag: 82.2, MMLU: 63.8, GSM8K: 44.9.

Base model:finetune:internlm/i... Base model:internlm/internlm2-... En Endpoints compatible Llama Region:us Safetensors Sharded Tensorflow Zh

Model Card on HF 🤗: https://huggingface.co/intervitens/internlm2-base-20b-llama

Internlm2 Base 20B Llama Parameters and Internals

Additional Notes

Special thanks to Charles Goddard for the conversion script to create llama models from internlm.

Supported Languages

en (Supported), zh (Supported)

LLM Name	Internlm2 Base 20B Llama
Repository 🤗	https://huggingface.co/intervitens/internlm2-base-20b-llama
Base Model(s)	Internlm2 Base 20B internlm/internlm2-base-20b
Model Size	20b
Required VRAM	39.6 GB
Updated	2026-07-08
Maintainer	intervitens
Model Type	llama
Model Files	9.9 GB: 1-of-4 9.9 GB: 2-of-4 9.9 GB: 3-of-4 9.9 GB: 4-of-4
Supported Languages	en zh
Model Architecture	LlamaForCausalLM
License	other
Context Length	32768
Model Max Length	32768
Transformers Version	4.36.2
Is Biased	0
Tokenizer Class	LlamaTokenizer
Padding Token	</s>
Vocabulary Size	92544
Torch Data Type	bfloat16

Rank the Internlm2 Base 20B Llama capabilities

Have you tried this model? Rate its performance — this feedback helps the ML community find the right model for their needs.

Instruction Following and Task Automation
Factuality and Completeness of Knowledge
Censorship and Alignment
Data Analysis and Insight Generation
Text Generation
Text Summarization and Feature Extraction
Code Generation
Multi-Language Support and Translation

Best Alternatives to Internlm2 Base 20B Llama

Best Alternatives	Context / RAM	Downloads	Likes
Internlm2 5 20B Llamafied	256K / 39.9 GB	7	5
EAGLE3 GPT Oss 20B	128K / 0.7 GB	507	0
Stellaris Internlm2 20B R512	32K / 39.8 GB	12	3
Internlm2 Chat 20B Llama Old	32K / 39.6 GB	8	3
Internlm2 Base 20B Llama	32K / 39.6 GB	6	3
Deita 20B	32K / 39.8 GB	63	1
Internlm2 20B Llama	32K / 39.6 GB	81	20
Bagel 20B V04 Llama	32K / 39.6 GB	6	7
Bagel DPO 20B V04 Llama	32K / 39.6 GB	7	3
Internlm2 Limarp Chat 20B	32K / 39.6 GB	10	3

Note: green Score (e.g. "73.2") means that the model is better than intervitens/internlm2-base-20b-llama.