LLM EXPLORER 59,358 MODELS INDEXED

GPT Neo 1.3B Dutch by yhavinga

By yhavinga · 101 downloads

GPT Neo 1.3B Dutch is an open-source language model by yhavinga. Features: 1.3b LLM, VRAM: 5.4GB, Context: 2K, LLM Explorer Score: 0.

Dataset:yhavinga/mc4 nl cleane...   Endpoints compatible   Gpt-neo   Gpt-neo-1.3b   Gpt neo   Jax   Nl   Pytorch   Region:us   Safetensors   Tensorboard

GPT Neo 1.3B Dutch Parameters and Internals

Model Type 
text generation
Additional Notes 
This project was supported by Google TPU Research Cloud and utilized HuggingFace tools extensively.
Supported Languages 
Dutch (native)
Training Details 
Data Sources:
cleaned Dutch mC4
Data Volume:
33B tokens
Methodology:
Trained from scratch for Dutch
Context Length:
512
Training Time:
7 days 11 hours
Hardware Used:
Google TPU through TPU Research Cloud
Model Architecture:
GPT-Neo, similar to GPT-3 but open-source
Input Output 
Input Format:
Text
Accepted Modalities:
text
Output Format:
Generated text
Release Notes 
Version:
1.3B
Notes:
Initial release of the Dutch GPT-Neo model with 1.3 billion parameters.
LLM NameGPT Neo 1.3B Dutch
Repository πŸ€—https://huggingface.co/yhavinga/gpt-neo-1.3B-dutch 
Model Size1.3b
Required VRAM5.4 GB
Updated2026-08-06
Maintaineryhavinga
Model Typegpt_neo
Model Files  5.4 GB   5.4 GB
Supported Languagesnl
Model ArchitectureGPTNeoForCausalLM
Context Length2048
Model Max Length2048
Transformers Version4.13.0
Tokenizer ClassGPT2Tokenizer
Vocabulary Size50257
Torch Data Typefloat32
Activation Functiongelu_new

Best Alternatives to GPT Neo 1.3B Dutch

Best Alternatives
Context / RAM
Downloads
Likes
GPT NEO 1.3B Wiki2K / 5.3 GB131
...ni Neo 1.3B Mental Health Lora2K / 1.6 GB822
GPT Neo 1.3B Lama2K / 5.3 GB60
GPT Neo 1.3B Alpaca2K / 5.3 GB50
GPT Neo 1.3B2K / 5.3 GB47067325
Adonalsium GPT Neo 1.3B2K / 0 GB11
GPT Neo 1.3B Cs Finetuning2K / 0.5 GB50
GPT NeoX 1.3B Viet Long 702K / 5.3 GB70
...oX 1.3B Viet Custom 30 General2K / 5.3 GB50
GPT NeoX 1.3B Viet Custom 302K / 5.3 GB90
Note: green Score (e.g. "73.2") means that the model is better than yhavinga/gpt-neo-1.3B-dutch.