Sparse0.5 OPT 1.3 is an open-source language model by shaohang. Features: 1.3b LLM, VRAM: 2.6GB, Context: 2K, License: apache-2.0, LLM Explorer Score: 0.13, Arc: 27.1, HellaSwag: 48.7, MMLU: 25.6, GSM8K: 0.1.
| LLM Name | Sparse0.5 OPT 1.3 |
| Repository 🤗 | https://huggingface.co/shaohang/Sparse0.5_OPT-1.3 |
| Model Size | 1.3b |
| Required VRAM | 2.6 GB |
| Updated | 2026-06-05 |
| Maintainer | shaohang |
| Model Type | opt |
| Model Files | |
| Model Architecture | OPTForCausalLM |
| License | apache-2.0 |
| Context Length | 2048 |
| Model Max Length | 2048 |
| Transformers Version | 4.29.1 |
| Beginning of Sentence Token | </s> |
| End of Sentence Token | </s> |
| Unk Token | </s> |
| Vocabulary Size | 50272 |
| Torch Data Type | float16 |
| Activation Function | relu |
| Errors | replace |
Best Alternatives |
Context / RAM |
Downloads |
Likes |
|---|---|---|---|
| LLmRa 1.3B V2 | 2K / 5.3 GB | 664 | 0 |
| Opt 1.3B | 2K / 2.6 GB | 121972 | 185 |
| ... Distilled PromptKD Dolly V1.0 | 2K / 2.6 GB | 7 | 0 |
| New Galactica 1.3b Mcq | 2K / 2.6 GB | 5 | 0 |
| ... Galactica 1.3b DPO 0.1beta Ai | 2K / 2.6 GB | 4 | 1 |
| New Galactica 1.3b Mcq Rag | 2K / 2.6 GB | 8 | 0 |
| New Galactica 1.3b Mcq No Rag | 2K / 2.6 GB | 6 | 0 |
| ... Galactica 1.3b DPO 0.1beta Ai | 2K / 2.6 GB | 5 | 0 |
| ...tica 1.3b 0.1beta Ai Raft Top3 | 2K / 2.6 GB | 8 | 0 |
| ...tica 1.3b 0.1beta Ai Raft Top4 | 2K / 2.6 GB | 5 | 0 |