LLM EXPLORER 58,133 MODELS INDEXED

GPT X2 125M by AxiomicLabs

By AxiomicLabs · 1173 downloads

GPT X2 125M is an open-source language model by AxiomicLabs. Features: 125m LLM, VRAM: 0.3GB, Context: 1K, License: apache-2.0, LLM Explorer Score: 0.27.

  Code-normalization   Curriculum-learning   Custom-architecture   Custom-tokenizer   Custom code Dataset:axiomiclabs/npset-pyth... Dataset:huggingfacefw/fineweb-...   Dataset:huggingfacetb/finemath Dataset:mlfoundations/dclm-bas...   En   Gptx2   Gqa   Language-model   Region:us   Rope   Safetensors   Swiglu

GPT X2 125M Parameters and Internals

LLM NameGPT X2 125M
Repository πŸ€—https://huggingface.co/AxiomicLabs/GPT-X2-125M 
Model Size125m
Required VRAM0.3 GB
Updated2026-08-11
MaintainerAxiomicLabs
Model Typegptx2
Model Files  0.3 GB
Supported Languagesen
Model ArchitectureGPTX2ForCausalLM
Licenseapache-2.0
Context Length1024
Model Max Length1024
Is Biased0
Tokenizer ClassGPT2Tokenizer
Padding Token<|padding|>
Vocabulary Size32768
Torch Data Typebfloat16