What are the hardware requirements for Model 007 13B V2?

Model 007 13B V2 requires approximately 26 GB of VRAM and supports a context window of 4K tokens. Quantized variants may run on less VRAM; see the Quantized Models section on this page.

Who developed Model 007 13B V2 and how large is it?

Model 007 13B V2 is developed by pankajmathur, a model with 13b parameters. The model is published as open weights on Hugging Face and indexed on LLM Explorer with full benchmark history.

Where can I download or evaluate Model 007 13B V2?

Model 007 13B V2 is hosted on Hugging Face and linked from this page. LLM Explorer also lists quantized variants and similar alternatives if available.

Model 007 13B V2 by pankajmathur — VRAM 26GB, 4K context

Name: Model 007 13B V2
Author: pankajmathur

Model 007 13B V2 is an open-source language model by pankajmathur. Features: 13b LLM, VRAM: 26GB, Context: 4K, License: llama2, Quantized, Instruction-Based, LLM Explorer Score: 0.13.

Arxiv:2306.02707 Dataset:databricks/databricks-... Dataset:ehartford/dolphin Dataset:garage-baind/open-plat... Dataset:psmathur/alpaca orca Dataset:psmathur/dolly-v2 orca Dataset:psmathur/orca mini v1 ... Dataset:psmathur/wizardlm orca Dataset:tatsu-lab/alpaca Dataset:wizardlm/wizardlm evol... En Endpoints compatible Fp16 Instruct Llama Model-index Pytorch Quantized Region:us Safetensors Sharded Tensorflow

Model Card on HF 🤗: https://huggingface.co/pankajmathur/model_007_13b_v2

Model 007 13B V2 Parameters and Internals

Model Type

text generation

Additional Notes

Model evaluates accurately with established benchmarks but can produce unexpected outputs. Approach results with caution due to potential bias and inaccuracies.

Supported Languages

en (high)

Input Output

Input Format:

The model expects prompts such as:\n### User: [Your question]\n### Assistant:\n

Accepted Modalities:

text

Output Format:

Text response relevant to the input prompt.

Performance Tips:

Ensure optimal GPU setup for large token generation and consider prompt structuring advice for best results.

LLM Name	Model 007 13b V2
Repository 🤗	https://huggingface.co/pankajmathur/model_007_13b_v2
Model Size	13b
Required VRAM	26 GB
Updated	2026-07-13
Maintainer	pankajmathur
Model Type	llama
Instruction-Based	Yes
Model Files	9.9 GB: 1-of-3 9.9 GB: 2-of-3 6.2 GB: 3-of-3 9.9 GB: 1-of-3 9.9 GB: 2-of-3 6.2 GB: 3-of-3
Supported Languages	en
Quantization Type	fp16
Model Architecture	LlamaForCausalLM
License	llama2
Context Length	4096
Model Max Length	4096
Transformers Version	4.32.0.dev0
Tokenizer Class	LlamaTokenizer
Beginning of Sentence Token	<s>
End of Sentence Token	</s>
Unk Token	<unk>
Vocabulary Size	32000
Torch Data Type	float16

Rank the Model 007 13B V2 capabilities

Have you tried this model? Rate its performance — this feedback helps the ML community find the right model for their needs.

Instruction Following and Task Automation
Factuality and Completeness of Knowledge
Censorship and Alignment
Data Analysis and Insight Generation
Text Generation
Text Summarization and Feature Extraction
Code Generation
Multi-Language Support and Translation

Best Alternatives to Model 007 13B V2

Best Alternatives	Context / RAM	Downloads	Likes
CodeLlama 13B Instruct Fp16	16K / 26 GB	137	28
...Llama 13B Instruct Hf 4bit MLX	16K / 7.8 GB	113	3
...13B Instruct Nf4 Fp16 Upscaled	16K / 26 GB	6	0
...B Fast Instruct 4bit Quantized	4K / 7.8 GB	6	0
...igogne2 Enno 13B Sft Lora 4bit	4K / 26 GB	786	0
Xwin LM 13B V0.2 EXL2	4K / 5.2 GB	12	3
Mythalion 13B 2.30bpw H4 EXL2	4K / 4.1 GB	4	3
...lion Kimiko V2.6.05bpw H8 EXL2	4K / 10.1 GB	5	1
Finance LLM 13B 6.0bpw H6 EXL2	2K / 10 GB	5	1
Law LLM 13B 4.0bpw H6 EXL2	2K / 6.8 GB	2	1