LLM EXPLORER 56,604 MODELS INDEXED

Pretraining Priors D26 Base by jkminder

By jkminder · 63 downloads

Pretraining Priors D26 Base is an open-source language model by jkminder. Features: 972.9m LLM, VRAM: 1.9GB, Context: 2K, License: cc-by-nc-4.0.

  Arxiv:2504.13161   Base-model   Custom code   Dataset:nvidia/climbmix   En   Nanochat   Nanochat gpt   Region:us   Research   Safetensors

Pretraining Priors D26 Base Parameters and Internals

LLM NamePretraining Priors D26 Base
Repository πŸ€—https://huggingface.co/jkminder/pretraining-priors-d26-base 
Model Size972.9m
Required VRAM1.9 GB
Updated2026-08-09
Maintainerjkminder
Model Typenanochat_gpt
Model Files  1.9 GB
Supported Languagesen
Model ArchitectureNanochatGPTForCausalLM
Licensecc-by-nc-4.0
Context Length2048
Model Max Length2048
Transformers Version5.14.1
Tokenizer ClassTokenizersBackend
Vocabulary Size32768