RedPajama 7B 16384 is an open-source language model by hakurei. Features: 7b LLM, VRAM: 36GB, Context: 16K, LLM Explorer Score: 0.07.
| LLM Name | RedPajama 7B 16384 |
| Repository 🤗 | https://huggingface.co/hakurei/RedPajama-7B-16384 |
| Model Size | 7b |
| Required VRAM | 36 GB |
| Updated | 2026-08-08 |
| Maintainer | hakurei |
| Model Type | gpt_neox |
| Model Files | |
| Model Architecture | GPTNeoXForCausalLM |
| Context Length | 16384 |
| Model Max Length | 16384 |
| Transformers Version | 4.28.1 |
| Tokenizer Class | GPTNeoXTokenizer |
| Vocabulary Size | 50432 |
| Torch Data Type | float32 |
Best Alternatives |
Context / RAM |
Downloads |
Likes |
|---|---|---|---|
| Literature 7B 16384 | 16K / 36 GB | 9 | 16 |
| Stablelm Tuned Alpha 7B | 4K / 31.9 GB | 713 | 361 |
| Stablelm Base Alpha 7B | 4K / 31.9 GB | 884 | 208 |
| Stablelm 7B Sft V7 Epoch 3 | 4K / 32.4 GB | 64 | 67 |
| StableLManticore 7B | 4K / 16 GB | 10 | 1 |
| Pythia 6.9B Deduped 4K | 4K / 27.2 GB | 8 | 10 |
| Stablelm 7B | 4K / 31.9 GB | 7 | 2 |
| Dolly V2 7B | 2K / 13.8 GB | 1596 | 150 |
| Open Calm 7B | 2K / 13.9 GB | 523 | 205 |
| Sarashina1 7B | 2K / 13.9 GB | 11 | 1 |