What are the hardware requirements for Rwkv 4 1b5 Pile?

Rwkv 4 1b5 Pile requires approximately 6.1 GB of VRAM. Quantized variants may run on less VRAM; see the Quantized Models section on this page.

Who developed Rwkv 4 1b5 Pile and how large is it?

Rwkv 4 1b5 Pile is developed by RWKV. The model is published as open weights on Hugging Face and indexed on LLM Explorer with full benchmark history.

How does Rwkv 4 1b5 Pile perform on standard benchmarks?

Rwkv 4 1b5 Pile has the following published scores: MMLU 25.77. Compare against reference models on this page or on the LLM Explorer leaderboards.

Rwkv 4 1b5 Pile by RWKV — VRAM 6.1GB

Name: Rwkv 4 1b5 Pile
Author: RWKV

Rwkv 4 1b5 Pile is an open-source language model by RWKV. Features: LLM, VRAM: 6.1GB, LLM Explorer Score: 0.11, Arc: 31.8, HellaSwag: 52.3, MMLU: 25.8.

Dataset:eleutherai/pile Endpoints compatible Pytorch Region:us Rwkv

Model Card on HF 🤗: https://huggingface.co/RWKV/rwkv-4-1b5-pile

Rwkv 4 1b5 Pile Parameters and Internals

Model Type

RNN, transformer-level, LLM

Training Details

Data Sources:

EleutherAI/pile

Model Architecture:

RWKV is an RNN with transformer-level performance. It combines features of RNN and transformer architectures.

LLM Name	Rwkv 4 1b5 Pile
Repository 🤗	https://huggingface.co/RWKV/rwkv-4-1b5-pile
Required VRAM	6.1 GB
Updated	2026-06-30
Maintainer	RWKV
Model Type	rwkv
Model Files	6.1 GB
Model Architecture	RwkvForCausalLM
Transformers Version	4.29.0.dev0
Tokenizer Class	GPTNeoXTokenizer
Vocabulary Size	50277
Torch Data Type	float32

Rank the Rwkv 4 1b5 Pile capabilities

Have you tried this model? Rate its performance — this feedback helps the ML community find the right model for their needs.

Instruction Following and Task Automation
Factuality and Completeness of Knowledge
Censorship and Alignment
Data Analysis and Insight Generation
Text Generation
Text Summarization and Feature Extraction
Code Generation
Multi-Language Support and Translation

Best Alternatives to Rwkv 4 1b5 Pile

Best Alternatives	Context / RAM	Downloads	Likes
EagleX 1 7T HF	0K / 15 GB	32	10
Rwkv Raven 1b5	0K / 6.1 GB	150	12
... Pileplus 1B5 Evol Instruct V2	0K / 6.1 GB	58	0
...t 1B4 L94 D1024 Rwkv Converted	0K / 5.3 GB	7	0
Music 4 Rwkv Converted	0K / 2.3 GB	7	0
Rwkv Musenet Test Untrained3	0K / 1.8 GB	11	0
Rwkv Musenet Test Untrained4	0K / 0.9 GB	7	0
Rwkv Musenet Test Untrained	0K / 0.1 GB	7	0
Rwkv Music3	0K / 1.7 GB	8	1
MuseRift	0K / 1.7 GB	5	0

Note: green Score (e.g. "73.2") means that the model is better than RWKV/rwkv-4-1b5-pile.