What are the hardware requirements for Mpt 7B Storywriter Qlora?

Mpt 7B Storywriter Qlora requires approximately 13.3 GB of VRAM. Quantized variants may run on less VRAM; see the Quantized Models section on this page.

Who developed Mpt 7B Storywriter Qlora and how large is it?

Mpt 7B Storywriter Qlora is developed by Jordancole21, a model with 7b parameters. The model is published as open weights on Hugging Face and indexed on LLM Explorer with full benchmark history.

Where can I download or evaluate Mpt 7B Storywriter Qlora?

Mpt 7B Storywriter Qlora is hosted on Hugging Face and linked from this page. LLM Explorer also lists quantized variants and similar alternatives if available.

Mpt 7B Storywriter Qlora by Jordancole21 — VRAM 13.3GB

Name: Mpt 7B Storywriter Qlora
Author: Jordancole21

Mpt 7B Storywriter Qlora is an open-source language model by Jordancole21. Features: 7b LLM, VRAM: 13.3GB, License: apache-2.0, LLM Explorer Score: 0.07.

Arxiv:2108.12409 Arxiv:2205.14135 Arxiv:2302.06675 Composer Custom code Dataset:the pile books3 Llm-foundry Mosaicml Mpt Pytorch Region:us Sharded

Model Card on HF 🤗: https://huggingface.co/Jordancole21/mpt-7b-storywriter-qlora

Mpt 7B Storywriter Qlora Parameters and Internals

Model Type

text generation

Use Cases

Areas:

fictional storytelling

Limitations:

May produce factually incorrect output and offensive content.

Considerations:

Avoid reliance on producing factually accurate information.

Additional Notes

The model can extrapolate beyond 65k tokens, with demonstrations up to 84k tokens using ALiBi.

Training Details

Data Sources:

the_pile_books3

Methodology:

Finetuned with a sequence length of 65536. Uses FlashAttention and ALiBi. Does not use positional embeddings or biases.

Context Length:

65536

Hardware Used:

8 A100-80GB GPUs

Model Architecture:

Modified decoder-only transformer architecture. Uses FlashAttention, ALiBi, does not use positional embeddings or biases.

LLM Name	Mpt 7B Storywriter Qlora
Repository 🤗	https://huggingface.co/Jordancole21/mpt-7b-storywriter-qlora
Model Size	7b
Required VRAM	13.3 GB
Updated	2026-07-23
Maintainer	Jordancole21
Model Type	mpt
Model Files	9.9 GB: 1-of-2 3.4 GB: 2-of-2
Model Architecture	MPTForCausalLM
License	apache-2.0
Model Max Length	65536
Transformers Version	4.28.1
Tokenizer Class	GPTNeoXTokenizer
Vocabulary Size	50432
Torch Data Type	bfloat16

Rank the Mpt 7B Storywriter Qlora capabilities

Have you tried this model? Rate its performance — this feedback helps the ML community find the right model for their needs.

Instruction Following and Task Automation
Factuality and Completeness of Knowledge
Censorship and Alignment
Data Analysis and Insight Generation
Text Generation
Text Summarization and Feature Extraction
Code Generation
Multi-Language Support and Translation

Quantized Models of the Mpt 7B Storywriter Qlora

Model	Likes	Downloads	VRAM
Mpt 7B Storywriter Q8	2	14	6 GB

Best Alternatives to Mpt 7B Storywriter Qlora

Best Alternatives	Context / RAM	Downloads	Likes
Mpt 7B Chat	0K / 13.3 GB	80920	518
Mpt 7B Assistant	0K / 13.3 GB	11	1
Mpt 7B	0K / 13.3 GB	18460	1173
Mpt 7B Instruct	0K / 13.3 GB	7946	470
Mpt 7B Storywriter	0K / 13.3 GB	2261	839
Mpt 7B Int8 Ov	0K / 0 GB	13	0
Mpt 7B	0K / 26.5 GB	3064	1
Mpt 7B 8K	0K / 13.3 GB	1915	26
Shears Mpt 7B 50 Base	0K / 13.3 GB	5	2
Mpt 7B 8K Chat	0K / 13.3 GB	1942	40

Note: green Score (e.g. "73.2") means that the model is better than Jordancole21/mpt-7b-storywriter-qlora.