LLM EXPLORER 59,420 MODELS INDEXED

Gpt2 Base Bne by PlanTL-GOB-ES

By PlanTL-GOB-ES · 1736 downloads

Gpt2 Base Bne is an open-source language model by PlanTL-GOB-ES. Features: LLM, VRAM: 0.5GB, License: apache-2.0, LLM Explorer Score: 0.21.

  Bne   Dataset:bne   Es   Gpt2-base-bne   National library of spain   Region:us   Spanish

Gpt2 Base Bne Parameters and Internals

Model Type 
text generation
Use Cases 
Areas:
text generation
Applications:
general use or fine-tuning for specific language tasks
Additional Notes 
At the time of submission, no measures have been taken to estimate the bias and toxicity embedded in the model.
Supported Languages 
Spanish (High proficiency)
Training Details 
Data Sources:
National Library of Spain (BNE)
Data Volume:
570GB of clean and deduplicated text
Methodology:
Next token prediction with Byte-Pair Encoding (BPE)
Training Time:
3 days on 16 computing nodes with 4 NVIDIA V100 GPUs of 16GB VRAM each.
Hardware Used:
16 computing nodes, each with 4 NVIDIA V100 GPUs of 16GB VRAM
Model Architecture:
12-layer, 768-hidden, 12-heads
Input Output 
Accepted Modalities:
text
LLM NameGpt2 Base Bne
Repository πŸ€—https://huggingface.co/PlanTL-GOB-ES/gpt2-base-bne 
Required VRAM0.5 GB
Updated2025-08-12
MaintainerPlanTL-GOB-ES
Model Typegpt2
Model Files  0.5 GB
Supported Languageses
Model ArchitectureGPT2LMHeadModel
Licenseapache-2.0
Vocabulary Size50261

Best Alternatives to Gpt2 Base Bne

Best Alternatives
Context / RAM
Downloads
Likes
Judge GPT20.5K / 0.4 GB100
Hanuman0K / 0.5 GB170
BrtGPT 1 Pre0K / 0.4 GB1320
GPT 2 Large 115K Steps0K / 0 GB110
GPT 2 Large 51K Steps0K / 0 GB70
GPT 2 Large 40K Steps0K / 0 GB100
GPT 2 Large 32K Steps0K / 0 GB120
GPT 2 Large 20K Steps0K / 0 GB90
GPT 2 Large 43K Steps0K / 0 GB80
Math Gpt20K / 0.5 GB7770