What are the hardware requirements for Internlm2 Math 20B?

Internlm2 Math 20B requires approximately 39.7 GB of VRAM and supports a context window of 8K tokens. Quantized variants may run on less VRAM; see the Quantized Models section on this page.

Who developed Internlm2 Math 20B and how large is it?

Internlm2 Math 20B is developed by internlm, a model with 20b parameters. The model is published as open weights on Hugging Face and indexed on LLM Explorer with full benchmark history.

Where can I download or evaluate Internlm2 Math 20B?

Internlm2 Math 20B is hosted on Hugging Face and linked from this page. LLM Explorer also lists quantized variants and similar alternatives if available.

Internlm2 Math 20B by internlm — VRAM 39.7GB, 8K context

Name: Internlm2 Math 20B
Author: internlm

Internlm2 Math 20B is an open-source language model by internlm. Features: 20b LLM, VRAM: 39.7GB, Context: 8K, License: other, LLM Explorer Score: 0.11.

Conversational Custom code En Internlm2 Math Region:us Safetensors Sharded Tensorflow Zh

Model Card on HF 🤗: https://huggingface.co/internlm/internlm2-math-20b

Internlm2 Math 20B Benchmarks

LLME Score: 0.11496

^nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").

What is the LLM Explorer Rank (Score)

Internlm2 Math 20B (internlm/internlm2-math-20b)

🌟 Advertise your project 🚀

Internlm2 Math 20B Parameters and Internals

Model Type

math reasoning, text generation

Use Cases

Areas:

Bilingual Math, Math reasoning, Verification

Applications:

Math problem solving, Math theorem proving, Mathematical chain-of-thought verification, Lean code use

Primary Use Cases:

Math problem solving and theorem proving, Generating Lean code for simple reasoning tasks, Outcome, process, and Lean reward modeling

Limitations:

Jumping calculation steps, Performance variance in some contexts, Tendency to generate code for Chinese problems, Some Lean capabilities limited to GSM8K-like problems

Additional Notes

The model integrates Lean language support, leveraging it for GSM8K and similar reasoning tests.

Supported Languages

en (high), zh (high)

Training Details

Data Sources:

InternLM2-Base, ~100B Math-related tokens, ~2M bilingual supervised data

Data Volume:

100 billion tokens

Methodology:

Continued pretraining and fine-tuning with specialized techniques such as minhash and exact number match to decontaminate possible test set leakage

Input Output

Input Format:

Text input expected

Accepted Modalities:

text

Output Format:

Text

Performance Tips:

Use prompt instructions correctly for optimal results.

Release Notes

Version:

InternLM2-Math-Base-7B

Date:

2024-01-23

Notes:

Pretrained checkpoint release.

Version:

InternLM2-Math-7B

Date:

2024-01-23

Notes:

SFT checkpoint release.

LLM Name	Internlm2 Math 20B
Repository 🤗	https://huggingface.co/internlm/internlm2-math-20b
Model Size	20b
Required VRAM	39.7 GB
Updated	2026-05-26
Maintainer	internlm
Model Type	internlm2
Model Files	1.9 GB: 1-of-21 1.9 GB: 2-of-21 2.0 GB: 3-of-21 1.9 GB: 4-of-21 2.0 GB: 5-of-21 1.9 GB: 6-of-21 2.0 GB: 7-of-21 1.9 GB: 8-of-21 2.0 GB: 9-of-21 1.9 GB: 10-of-21 2.0 GB: 11-of-21 1.9 GB: 12-of-21 2.0 GB: 13-of-21 1.9 GB: 14-of-21 2.0 GB: 15-of-21 1.9 GB: 16-of-21 2.0 GB: 17-of-21 1.9 GB: 18-of-21 2.0 GB: 19-of-21 1.6 GB: 20-of-21 1.1 GB: 21-of-21
Supported Languages	en zh
Model Architecture	InternLM2ForCausalLM
License	other
Context Length	8192
Model Max Length	8192
Transformers Version	4.35.2
Is Biased	0
Tokenizer Class	InternLM2Tokenizer
Padding Token	</s>
Vocabulary Size	92544
Torch Data Type	bfloat16

Quantized Models of the Internlm2 Math 20B

Model	Likes	Downloads	VRAM
Internlm2 Math 20B AWQ	0	6	12 GB

Best Alternatives to Internlm2 Math 20B

Best Alternatives	Context / RAM	Downloads	Likes
Internlm2 5 20B	256K / 39.7 GB	135	17
Internlm2 5 20B Chat	32K / 39.7 GB	1275	94
Internlm2 Chat 20B ExPO	32K / 39.8 GB	16283	1
Internlm2 20B	32K / 39.7 GB	19933	59
Internlm2 Chat 20B	32K / 39.7 GB	20919	88
Internlm2 Base 20B	32K / 39.7 GB	16701	8
...ternlm2 5 20B Chat Abliterated	32K / 39.7 GB	149	4
ChemLLM 20B Chat DPO	32K / 40.6 GB	311	10
ChemLLM 20B Chat SFT	32K / 40.6 GB	54	5
Internlm Chatbode 20B	32K / 39.8 GB	20	1

Note: green Score (e.g. "73.2") means that the model is better than internlm/internlm2-math-20b.

Rank the Internlm2 Math 20B Capabilities

🆘 Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! 🌟

Instruction Following and Task Automation
Factuality and Completeness of Knowledge
Censorship and Alignment
Data Analysis and Insight Generation
Text Generation
Text Summarization and Feature Extraction
Code Generation
Multi-Language Support and Translation

What open-source LLMs or SLMs are you in search of? 53999 in total.

Email us: info@extractum.io. Our Privacy Policy | Terms and Conditions | Suggest an improvement.

Our Social Media →

Original data from HuggingFace, OpenCompass and various public git repos.

Check out Ag3ntum — our secure, self-hosted AI agent for server management.

Release v20260328a

Support LLM Explorer

Internlm2 Math 20B by internlm