LLM EXPLORER 59,420 MODELS INDEXED

Mistral Pretraining by Mithilhf01

By Mithilhf01 · 10 downloads

Mistral Pretraining is an open-source language model by Mithilhf01. Features: 117.6m LLM, VRAM: 0.5GB, Context: 0.5K, LLM Explorer Score: 0.16.

  Dataset:wikipedia   Endpoints compatible   Generated from trainer   Mistral   Region:us   Safetensors   Tensorboard

Mistral Pretraining Parameters and Internals

LLM NameMistral Pretraining
Repository πŸ€—https://huggingface.co/Mithilhf01/mistral-pretraining 
Model Size117.6m
Required VRAM0.5 GB
Updated2026-08-03
MaintainerMithilhf01
Model Typemistral
Model Files  0.5 GB   0.0 GB
Model ArchitectureMistralForCausalLM
Context Length512
Model Max Length512
Transformers Version4.47.1
Tokenizer ClassLlamaTokenizer
Padding Token</s>
Vocabulary Size32000
Torch Data Typefloat32