What are the hardware requirements for Mistral NeMo Minitron 8B Chat?

Mistral NeMo Minitron 8B Chat requires approximately 16.8 GB of VRAM and supports a context window of 8K tokens. Quantized variants may run on less VRAM; see the Quantized Models section on this page.

Who developed Mistral NeMo Minitron 8B Chat and how large is it?

Mistral NeMo Minitron 8B Chat is developed by rasyosef, a model with 8b parameters. The model is published as open weights on Hugging Face and indexed on LLM Explorer with full benchmark history.

Where can I download or evaluate Mistral NeMo Minitron 8B Chat?

Mistral NeMo Minitron 8B Chat is hosted on Hugging Face and linked from this page. LLM Explorer also lists quantized variants and similar alternatives if available.

Mistral NeMo Minitron 8B Chat by rasyosef — VRAM 16.8GB, 8K context

Name: Mistral NeMo Minitron 8B Chat
Author: rasyosef

Mistral NeMo Minitron 8B Chat is an open-source language model by rasyosef. Features: 8b LLM, VRAM: 16.8GB, Context: 8K, License: other, LLM Explorer Score: 0.19.

Base model:finetune:nvidia/mis... Base model:nvidia/mistral-nemo... Conversational Dataset:teknium/openhermes-2.5 Endpoints compatible Mistral Model-index Region:us Safetensors Sharded Tensorflow

Model Card on HF 🤗: https://huggingface.co/rasyosef/Mistral-NeMo-Minitron-8B-Chat

Mistral NeMo Minitron 8B Chat Parameters and Internals

Model Type

text-generation

Additional Notes

Best suited for prompts using chat format.

Training Details

Data Sources:

teknium/OpenHermes-2.5

Data Volume:

32k instruction-response pairs

Methodology:

supervised fine-tuning

Input Output

Input Format:

chat format

Accepted Modalities:

text

LLM Name	Mistral NeMo Minitron 8B Chat
Repository 🤗	https://huggingface.co/rasyosef/Mistral-NeMo-Minitron-8B-Chat
Base Model(s)	Mistral NeMo Minitron 8B Base nvidia/Mistral-NeMo-Minitron-8B-Base
Model Size	8b
Required VRAM	16.8 GB
Updated	2026-08-04
Maintainer	rasyosef
Model Type	mistral
Model Files	4.9 GB: 1-of-4 5.0 GB: 2-of-4 4.9 GB: 3-of-4 2.0 GB: 4-of-4
Model Architecture	MistralForCausalLM
License	other
Context Length	8192
Model Max Length	8192
Transformers Version	4.44.2
Tokenizer Class	PreTrainedTokenizerFast
Padding Token	<\|im_end\|>
Vocabulary Size	131074
Torch Data Type	bfloat16

Rank the Mistral NeMo Minitron 8B Chat capabilities

Have you tried this model? Rate its performance — this feedback helps the ML community find the right model for their needs.

Instruction Following and Task Automation
Factuality and Completeness of Knowledge
Censorship and Alignment
Data Analysis and Insight Generation
Text Generation
Text Summarization and Feature Extraction
Code Generation
Multi-Language Support and Translation

Best Alternatives to Mistral NeMo Minitron 8B Chat

Best Alternatives	Context / RAM	Downloads	Likes
Ministral 8B Instruct 2410 HF	32K / 32 GB	21	12
Ministrations 8B V1	32K / 16.1 GB	20	29
Minerva 8B	32K / 14.5 GB	7	0
...l 8B Instruct 2410 Abliterated	32K / 16.1 GB	46	3
Ministral 8B Slerp	32K / 29.2 GB	7	0
The Omega Directive M 8B V1.0	32K / 16.1 GB	30	9
Mistral Pro 8B V0.1	32K / 17.9 GB	83	67
Deeplm Mistral V0.1 8B Stage1	32K / 14.5 GB	16	1
Forgotten Abomination 8B V2.2	32K / 16.1 GB	11	2
Forgotten Safeword 8B V2.2	32K / 16.1 GB	4	1

Note: green Score (e.g. "73.2") means that the model is better than rasyosef/Mistral-NeMo-Minitron-8B-Chat.