Pythia 2.8B 4bit Alpaca is an open-source language model by TFLai. Features: 2.8b LLM, Quantized, LLM Explorer Score: 0.12, Arc: 34.7, HellaSwag: 59, MMLU: 25.5, GSM8K: 0.6.
| Training Details |
|
| LLM Name | Pythia 2.8B 4bit Alpaca |
| Repository 🤗 | https://huggingface.co/TFLai/pythia-2.8b-4bit-alpaca |
| Model Size | 2.8b |
| Required VRAM | 0 GB |
| Updated | 2026-07-07 |
| Maintainer | TFLai |
| Model Files | |
| Quantization Type | 4bit |
| Model Architecture | Adapter |
| Is Biased | none |
| PEFT Type | LORA |
| LoRA Model | Yes |
| PEFT Target Modules | query_key_value |
| LoRA Alpha | 32 |
| LoRA Dropout | 0.05 |
| R Param | 32 |
Best Alternatives |
Context / RAM |
Downloads |
Likes |
|---|---|---|---|
| Pretype One | 0K / 1.6 GB | 103 | 2 |
| ...n Generation Pharmacology Lora | 0K / 5.6 GB | 9 | 1 |
| Phi 2 Instruct | 0K / 11.1 GB | 124 | 33 |