Gpt2 Base Bne by PlanTL-GOB-ES

 ยป  All LLMs  ยป  PlanTL-GOB-ES  ยป  Gpt2 Base Bne   URL Share it on

  Bne   Dataset:bne   Es   Gpt2-base-bne   National library of spain   Region:us   Spanish

Gpt2 Base Bne Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
Gpt2 Base Bne (PlanTL-GOB-ES/gpt2-base-bne)
๐ŸŒŸ Advertise your project ๐Ÿš€

Gpt2 Base Bne Parameters and Internals

Model Type 
text generation
Use Cases 
Areas:
text generation
Applications:
general use or fine-tuning for specific language tasks
Additional Notes 
At the time of submission, no measures have been taken to estimate the bias and toxicity embedded in the model.
Supported Languages 
Spanish (High proficiency)
Training Details 
Data Sources:
National Library of Spain (BNE)
Data Volume:
570GB of clean and deduplicated text
Methodology:
Next token prediction with Byte-Pair Encoding (BPE)
Training Time:
3 days on 16 computing nodes with 4 NVIDIA V100 GPUs of 16GB VRAM each.
Hardware Used:
16 computing nodes, each with 4 NVIDIA V100 GPUs of 16GB VRAM
Model Architecture:
12-layer, 768-hidden, 12-heads
Input Output 
Accepted Modalities:
text
LLM NameGpt2 Base Bne
Repository ๐Ÿค—https://huggingface.co/PlanTL-GOB-ES/gpt2-base-bne 
Required VRAM0.5 GB
Updated2025-07-31
MaintainerPlanTL-GOB-ES
Model Typegpt2
Model Files  0.5 GB
Supported Languageses
Model ArchitectureGPT2LMHeadModel
Licenseapache-2.0
Vocabulary Size50261

Best Alternatives to Gpt2 Base Bne

Best Alternatives
Context / RAM
Downloads
Likes
BrtGPT 1 Pre0K / 0.4 GB1320
GPT 2 Large 115K Steps0K / 0 GB50
GPT 2 Large 51K Steps0K / 0 GB110
GPT 2 Large 40K Steps0K / 0 GB50
GPT 2 Large 32K Steps0K / 0 GB50
GPT 2 Large 20K Steps0K / 0 GB50
GPT 2 Large 43K Steps0K / 0 GB50
Distilgpt2 Openvino0K / 0.3 GB70
My Model0K /  GB410
My Model V20K /  GB50

Rank the Gpt2 Base Bne Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 50299 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241124