What are the hardware requirements for Llama 2 Coder 7B?

Llama 2 Coder 7B requires approximately 13.5 GB of VRAM and supports a context window of 4K tokens. Quantized variants may run on less VRAM; see the Quantized Models section on this page.

Who developed Llama 2 Coder 7B and how large is it?

Llama 2 Coder 7B is developed by mrm8488, a model with 7b parameters. The model is published as open weights on Hugging Face and indexed on LLM Explorer with full benchmark history.

How does Llama 2 Coder 7B perform on standard benchmarks?

Llama 2 Coder 7B has the following published scores: MMLU 46.25. Compare against reference models on this page or on the LLM Explorer leaderboards.

Llama 2 Coder 7B by mrm8488 — VRAM 13.5GB, 4K context

Name: Llama 2 Coder 7B
Author: mrm8488

Llama 2 Coder 7B is an open-source language model by mrm8488. Features: 7b LLM, VRAM: 13.5GB, Context: 4K, License: apache-2.0, Code Generating, LLM Explorer Score: 0.11, Arc: 54, HellaSwag: 78.4, MMLU: 46.3, GSM8K: 7.1.

Code Codegen Coding Dataset:huggingfaceh4/codealpa... Deploy:azure Doi:10.57967/hf/0931 Endpoints compatible Generated from trainer Llama Pytorch Region:us Sharded

Model Card on HF 🤗: https://huggingface.co/mrm8488/llama-2-coder-7b

Llama 2 Coder 7B Parameters and Internals

Model Type

text generation, code generation

Use Cases

Areas:

code assistance, instruction-driven code tasks, commercial

Applications:

software development, code refactoring, coding education

Primary Use Cases:

Coding assistant, Instruction-driven code assistance

Supported Languages

programming_languages (.all programming languages, focusing on instruction-driven tasks.)

Training Details

Data Sources:

HuggingFaceH4/CodeAlpaca_20K

Data Volume:

20K instruction-following data

Methodology:

QLoRA fine-tuning with PEFT library

Model Architecture:

Llama-2-Chat fine-tuned with QLoRA

Safety Evaluation

Methodologies:

Human evaluations for helpfulness and safety

Findings:

On par with ChatGPT and PaLM for dialogue use cases

Input Output

Input Format:

Instruction as a prompt

Accepted Modalities:

text

Output Format:

Generated text solution

LLM Name	Llama 2 Coder 7B
Repository 🤗	https://huggingface.co/mrm8488/llama-2-coder-7b
Model Size	7b
Required VRAM	13.5 GB
Updated	2026-08-02
Maintainer	mrm8488
Model Type	llama
Model Files	10.0 GB: 1-of-2 3.5 GB: 2-of-2
Supported Languages	code
Generates Code	Yes
Model Architecture	LlamaForCausalLM
License	apache-2.0
Context Length	4096
Model Max Length	4096
Transformers Version	4.31.0
Tokenizer Class	LlamaTokenizer
Beginning of Sentence Token	<s>
End of Sentence Token	</s>
Unk Token	<unk>
Vocabulary Size	32000
Torch Data Type	bfloat16

Rank the Llama 2 Coder 7B capabilities

Have you tried this model? Rate its performance — this feedback helps the ML community find the right model for their needs.

Instruction Following and Task Automation
Factuality and Completeness of Knowledge
Censorship and Alignment
Data Analysis and Insight Generation
Text Generation
Text Summarization and Feature Extraction
Code Generation
Multi-Language Support and Translation

Quantized Models of the Llama 2 Coder 7B

Model	Likes	Downloads	VRAM
Llama 2 Coder 7B GGUF	15	867	2 GB
Llama 2 Coder 7B AWQ	3	8	3 GB
Llama 2 Coder 7B GPTQ	10	33	3 GB

Best Alternatives to Llama 2 Coder 7B

Best Alternatives	Context / RAM	Downloads	Likes
Deepseek Coder 6.7B Instruct	16K / 13.5 GB	535311	507
CodeLlama 7B Hf	16K / 13.5 GB	254150	377
CodeLlama 7B Instruct Hf	16K / 13.5 GB	58587	258
GetCode Slerp	16K / 13.6 GB	87	1
Wizardllama 7B	16K / 13.5 GB	48	0
GoLLIE 7B	16K / 40.5 GB	2779	32
Codellama 7B Hf ReFT GSM8k	16K / 13.5 GB	459	1
MathCoder2 CodeLlama 7B	16K / 13.5 GB	10	5
Stack Codellama 7B Inst	16K / 13.5 GB	66	0
CodeLlama 7B Python Hf	16K / 13.5 GB	1935	146

Note: green Score (e.g. "73.2") means that the model is better than mrm8488/llama-2-coder-7b.