What are the hardware requirements for Mistral 7B Bnb 4bit Q4 K M?

Mistral 7B Bnb 4bit Q4 K M requires approximately 4.4 GB of VRAM. Quantized variants may run on less VRAM; see the Quantized Models section on this page.

Who developed Mistral 7B Bnb 4bit Q4 K M and how large is it?

Mistral 7B Bnb 4bit Q4 K M is developed by AlekseyElygin, a model with 7b parameters. The model is published as open weights on Hugging Face and indexed on LLM Explorer with full benchmark history.

Where can I download or evaluate Mistral 7B Bnb 4bit Q4 K M?

Mistral 7B Bnb 4bit Q4 K M is hosted on Hugging Face and linked from this page. LLM Explorer also lists quantized variants and similar alternatives if available.

Mistral 7B Bnb 4bit Q4 K M by AlekseyElygin — VRAM 4.4GB

Name: Mistral 7B Bnb 4bit Q4 K M
Author: AlekseyElygin

Mistral 7B Bnb 4bit Q4 K M is an open-source language model by AlekseyElygin. Features: 7b LLM, VRAM: 4.4GB, License: apache-2.0, Quantized, LLM Explorer Score: 0.13.

4bit Base model:quantized:unsloth/m... Base model:unsloth/mistral-7b-... En Endpoints compatible Gguf Mistral Q4 Quantized Region:us Unsloth

Model Card on HF 🤗: https://huggingface.co/AlekseyElygin/mistral-7b-bnb-4bit-q4_k_m

Mistral 7B Bnb 4bit Q4 K M Benchmarks

LLME Score: 0.1299

^nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").

What is the LLM Explorer Rank (Score)

Mistral 7B Bnb 4bit Q4 K M (AlekseyElygin/mistral-7b-bnb-4bit-q4_k_m)

Mistral 7B Bnb 4bit Q4 K M Parameters and Internals

Model Type

text-generation-inference

Additional Notes

This model was trained 2x faster using Unsloth and Huggingface's TRL library.

LLM Name	Mistral 7B Bnb 4bit Q4 K M
Repository 🤗	https://huggingface.co/AlekseyElygin/mistral-7b-bnb-4bit-q4_k_m
Base Model(s)	Mistral 7B Bnb 4bit unsloth/mistral-7b-bnb-4bit
Model Size	7b
Required VRAM	4.4 GB
Updated	2026-07-24
Maintainer	AlekseyElygin
Model Type	mistral
Model Files	4.4 GB
Supported Languages	en
GGUF Quantization	Yes
Quantization Type	gguf\|q4\|4bit\|q4_k
Model Architecture	AutoModel
License	apache-2.0

Best Alternatives to Mistral 7B Bnb 4bit Q4 K M

Best Alternatives	Context / RAM	Downloads	Likes
Pixel	8K / 4.4 GB	17	0
Qwen2 7B Alpacha Q8 0	0K / 9.1 GB	12	0
...ral 7B Instruct V0.2 Llamafile	0K / 14.5 GB	8850	25
Conversely Mistral 7B	0K / 0.2 GB	204	0
Mistral 7B Instruct V0.3 GGUF	0K / 1.6 GB	107573	147
Qwen2 7B Instruct GGUF	0K / 1.9 GB	56414	10
WizardLM 2 7B GGUF	0K / 2.7 GB	144443	83
CleverBoi 7B V2	0K / 0.1 GB	165	0
Mistral 7B Instruct V0.2 GGUF	0K / 3.1 GB	70243	511
...hemeng Qwen Math 7b 24 1 100 1	0K / 15.2 GB	25	0

Note: green Score (e.g. "73.2") means that the model is better than AlekseyElygin/mistral-7b-bnb-4bit-q4_k_m.

Rank the Mistral 7B Bnb 4bit Q4 K M Capabilities

🆘 Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! 🌟

Instruction Following and Task Automation
Factuality and Completeness of Knowledge
Censorship and Alignment
Data Analysis and Insight Generation
Text Generation
Text Summarization and Feature Extraction
Code Generation
Multi-Language Support and Translation

What open-source LLMs or SLMs are you in search of? 55396 in total.

Email us: info@extractum.io. Our Privacy Policy | Terms and Conditions | Suggest an improvement.

Our Social Media →

Original data from HuggingFace, Arena and various public git repos.

Check out Ag3ntum — our secure, self-hosted AI agent for server management.

Release v20260328a

Support LLM Explorer

Mistral 7B Bnb 4bit Q4 K M by AlekseyElygin

» All LLMs » AlekseyElygin » Mistral 7B Bnb 4bit Q4 K M URL Share it on

Mistral 7B Bnb 4bit Q4 K M Benchmarks

Mistral 7B Bnb 4bit Q4 K M Parameters and Internals

Best Alternatives to Mistral 7B Bnb 4bit Q4 K M

Rank the Mistral 7B Bnb 4bit Q4 K M Capabilities

What open-source LLMs or SLMs are you in search of? 55396 in total.