LLM EXPLORER 59,420 MODELS INDEXED

Gpt3 Finnish 3B by TurkuNLP

By TurkuNLP · 124 downloads

Gpt3 Finnish 3B is an open-source language model by TurkuNLP. Features: 3b LLM, VRAM: 11.4GB, License: apache-2.0, LLM Explorer Score: 0.05.

  Arxiv:2203.02155   Bloom   Endpoints compatible   Feature-extraction   Fi   Pytorch   Region:us

Gpt3 Finnish 3B Parameters and Internals

Model Type 
pretrained, language model, text generation
Additional Notes 
Note that the models are pure language models, meaning that they are not instruction finetuned for dialogue or answering questions. The intention is to use them as foundational models that can be instruction finetuned.
Supported Languages 
Finnish (native)
Training Details 
Data Sources:
Finnish Internet Parsebank, mC4, Common Crawl Finnish, Finnish Wikipedia, Lönnrot Projekti, ePub National library, National library 'lehdet' collection, Suomi24, Reddit r/Suomi, STT Finnish News Agency Archive, Yle Finnish News Archive
Data Volume:
300B tokens
Model Architecture:
BLOOM-architecture
LLM NameGpt3 Finnish 3B
Repository 🤗https://huggingface.co/TurkuNLP/gpt3-finnish-3B 
Model Size3b
Required VRAM11.4 GB
Updated2026-08-06
MaintainerTurkuNLP
Model Typebloom
Model Files  11.4 GB
Supported Languagesfi
Model ArchitectureBloomModel
Licenseapache-2.0
Model Max Length2048
Transformers Version4.26.0.dev0
Tokenizer ClassBloomTokenizer
Padding Token<pad>
Vocabulary Size131072