LLM EXPLORER 59,516 MODELS INDEXED

Story Mixtral 8x7b Lora by nicce

By nicce · 5 downloads

Story Mixtral 8x7b Lora is an open-source language model by nicce. Features: 7b LLM, MoE, LLM Explorer Score: 0.11.

  Adapter Base model:adapter:meta-llama/... Base model:meta-llama/llama-2-...   Finetuned   Lora   Moe   Peft   Region:us   Safetensors

Story Mixtral 8x7b Lora Parameters and Internals

Additional Notes 
This model uses the peft library to create a lora adapter, allowing for testing and deployment on GPU using transformers.
LLM NameStory Mixtral 8x7b Lora
Repository πŸ€—https://huggingface.co/nicce/story-mixtral-8x7b-lora 
Base Model(s)  Llama 2 7B Chat Hf   meta-llama/Llama-2-7b-chat-hf
Model Size7b
Required VRAM0 GB
Updated2026-07-24
Maintainernicce
Model Files  0.0 GB   0.0 GB
Model ArchitectureAdapter
Is Biasednone
Tokenizer ClassLlamaTokenizer
Padding Token</s>
PEFT TypeLORA
LoRA ModelYes
PEFT Target Modulesv_proj|q_proj
LoRA Alpha32
LoRA Dropout0.05
R Param16

Best Alternatives to Story Mixtral 8x7b Lora

Best Alternatives
Context / RAM
Downloads
Likes
Qwen Megumin0K / 0.1 GB111
Mistral 7B Instruct Vi Alpaca0K / 0.4 GB50
...s 25 Mistral 7B Irca DPO Pairs0K / 0.1 GB60
Qwen1.5 7B Chat Sa V0.10K / 0 GB80
Uk Fraud Chatbot Llama20K / 0.4 GB60
Zephyr 7B Ipo 0K 15K I10K / 0.7 GB50
Deepseek Llm 7B Chat Sa V0.10K / 0 GB70
Hr Other 7B Lora0K / 0.2 GB300
Mistral 7B Instruct Sa V0.10K / 0 GB90
Deepthink Reasoning Adapter0K / 0.2 GB163
Note: green Score (e.g. "73.2") means that the model is better than nicce/story-mixtral-8x7b-lora.