LLM EXPLORER 55,709 MODELS INDEXED

GPT X2.5 135M by AxiomicLabs

By AxiomicLabs · 617 downloads

GPT X2.5 135M is an open-source language model by AxiomicLabs. Features: 135m LLM, VRAM: 0.5GB, Context: 8K, License: apache-2.0, LLM Explorer Score: 0.28.

  Code-normalization   Curriculum-learning   Custom-architecture   Custom-tokenizer   Custom code Dataset:axiomiclabs/arithmark-... Dataset:axiomiclabs/npset-2-py... Dataset:huggingfacefw/finephra... Dataset:huggingfacefw/fineweb-... Dataset:huggingfacetb/cosmoped...   Dataset:huggingfacetb/finemath Dataset:huggingfacetb/smol-smo... Dataset:mlfoundations/dclm-bas...   En   Gptx2   Language-model   Region:us   Rope   Safetensors   Swiglu   Tx-3   Xgqa

GPT X2.5 135M Parameters and Internals

LLM NameGPT X2.5 135M
Repository πŸ€—https://huggingface.co/AxiomicLabs/GPT-X2.5-135M 
Model Size135m
Required VRAM0.5 GB
Updated2026-08-08
MaintainerAxiomicLabs
Model Typegptx2
Model Files  0.5 GB
Supported Languagesen
Model ArchitectureGPTX2ForCausalLM
Licenseapache-2.0
Context Length8192
Model Max Length8192
Is Biased0
Tokenizer ClassPreTrainedTokenizerFast
Padding Token<|padding|>
Vocabulary Size32770
Torch Data Typefloat32