What are the hardware requirements for Limarp Zloss Mixtral 8x7b Qlora?

Limarp Zloss Mixtral 8x7b Qlora requires approximately 1.9 GB of VRAM. Quantized variants may run on less VRAM; see the Quantized Models section on this page.

Who developed Limarp Zloss Mixtral 8x7b Qlora and how large is it?

Limarp Zloss Mixtral 8x7b Qlora is developed by Doctor-Shotgun. The model is published as open weights on Hugging Face and indexed on LLM Explorer with full benchmark history.

Where can I download or evaluate Limarp Zloss Mixtral 8x7b Qlora?

Limarp Zloss Mixtral 8x7b Qlora is hosted on Hugging Face and linked from this page. LLM Explorer also lists quantized variants and similar alternatives if available.

Limarp Zloss Mixtral 8x7b Qlora by Doctor-Shotgun — VRAM 1.9GB

Name: Limarp Zloss Mixtral 8x7b Qlora
Author: Doctor-Shotgun

Limarp Zloss Mixtral 8x7b Qlora is an open-source language model by Doctor-Shotgun. Features: LLM, VRAM: 1.9GB, License: apache-2.0, MoE, LLM Explorer Score: 0.1.

4-bit Adapter Base model:adapter:mistralai/m... Base model:mistralai/mixtral-8... Bitsandbytes Dataset:lemonilia/limarp En Finetuned Generated from trainer Lora Mixtral Moe Peft Region:us Safetensors

Model Card on HF 🤗: https://huggingface.co/Doctor-Shotgun/limarp-zloss-mixtral-8x7b-qlora

Limarp Zloss Mixtral 8x7b Qlora Parameters and Internals

Use Cases

Limitations:

Model will show biases similar to those observed in niche roleplaying forums., Biases exhibited by the base model.

Additional Notes

The model can ramble or impersonate the user with very long messages.

Supported Languages

en (unknown)

Training Details

Data Sources:

lemonilia/LimaRP

Methodology:

Experimental limarp qlora trained at 10k ctx length.

Context Length:

10000

Model Architecture:

Based on a fork of transformers with ZLoss and Megablocks

Input Output

Input Format:

Alpaca instruction format from LimaRP v3 for roleplaying scenarios.

Accepted Modalities:

text

Output Format:

Roleplaying dialogue format, with response length modifiers.

Performance Tips:

Omit length modifier for automatic length adjustment.

LLM Name	Limarp Zloss Mixtral 8x7b Qlora
Repository 🤗	https://huggingface.co/Doctor-Shotgun/limarp-zloss-mixtral-8x7b-qlora
Base Model(s)	mistralai/Mixtral-8x7B-v0.1 mistralai/Mixtral-8x7B-v0.1
Required VRAM	1.9 GB
Updated	2025-09-23
Maintainer	Doctor-Shotgun
Model Files	1.9 GB
Supported Languages	en
Model Architecture	Adapter
License	apache-2.0
Is Biased	none
Tokenizer Class	LlamaTokenizer
Padding Token	</s>
PEFT Type	LORA
LoRA Model	Yes
PEFT Target Modules	w2\|k_proj\|q_proj\|o_proj\|w1\|v_proj\|w3\|gate
LoRA Alpha	16
LoRA Dropout	0.05
R Param	32

Rank the Limarp Zloss Mixtral 8x7b Qlora capabilities

Have you tried this model? Rate its performance — this feedback helps the ML community find the right model for their needs.

Instruction Following and Task Automation
Factuality and Completeness of Knowledge
Censorship and Alignment
Data Analysis and Insight Generation
Text Generation
Text Summarization and Feature Extraction
Code Generation
Multi-Language Support and Translation

Best Alternatives to Limarp Zloss Mixtral 8x7b Qlora

Best Alternatives	Context / RAM	Downloads	Likes
... Flan T5 Large Second Try Lora	0K / 0.1 GB	16	1
Qwen3 Belarusian	0K / 0.1 GB	0	2
Phi 3 Mini 4K Instruct Sa V0.1	0K / 0 GB	6	0
Nemo Kimi Lora	0K / 1.8 GB	9	0
Nemo Books Lora 4	0K / 1.8 GB	6	0
Nemo Books Lora	0K / 1.8 GB	6	0
Llava Rad	0K / 0.3 GB	605	25
Reflection Model	0K / 0.2 GB	0	1
Francois KTO Lora	0K / 0 GB	11	0
Francois KTO Lora	0K / 0 GB	5	0

Note: green Score (e.g. "73.2") means that the model is better than Doctor-Shotgun/limarp-zloss-mixtral-8x7b-qlora.