GPT Sw3 126M Instruct is an open-source language model by AI-Sweden-Models. Features: 126m LLM, VRAM: 0.6GB, License: other, Instruction-Based, LLM Explorer Score: 0.11, Arc: 23.4, HellaSwag: 29.9, MMLU: 23.8, GSM8K: 1.
| LLM Name | GPT Sw3 126M Instruct |
| Repository 🤗 | https://huggingface.co/AI-Sweden-Models/gpt-sw3-126m-instruct |
| Base Model(s) | |
| Model Size | 126m |
| Required VRAM | 0.6 GB |
| Updated | 2026-07-20 |
| Maintainer | AI-Sweden-Models |
| Model Type | gpt2 |
| Instruction-Based | Yes |
| Model Files | |
| Supported Languages | da sv no en is |
| Model Architecture | GPT2LMHeadModel |
| License | other |
| Model Max Length | 2048 |
| Transformers Version | 4.22.1 |
| Tokenizer Class | GPTSw3Tokenizer |
| Padding Token | <pad> |
| Vocabulary Size | 64000 |
| Torch Data Type | float32 |
| Activation Function | gelu |