LLM EXPLORER 63,287 MODELS INDEXED

Tinymixtral by mikecovlee

By mikecovlee · 560 downloads

Tinymixtral is an open-source language model by mikecovlee. Features: 477.5m LLM, VRAM: 1.9GB, Context: 2K, License: mit, LLM Explorer Score: 0.3.

  Conversational   Custom code Dataset:huggingfacefw/fineweb-... Dataset:huggingfacetb/cosmoped... Dataset:mlfoundations/dclm-bas... Dataset:nvidia/opencodeinstruc... Dataset:open-web-math/open-web...   Dataset:wikimedia/wikipedia   En   Mixture-of-experts   Moe   Region:us   Safetensors   Tinymixtral
Model Card on HF πŸ€—: https://huggingface.co/mikecovlee/tinymixtral 

Tinymixtral Parameters and Internals

LLM NameTinymixtral
Repository πŸ€—https://huggingface.co/mikecovlee/tinymixtral 
Model Size477.5m
Required VRAM1.9 GB
Updated2026-10-07
Maintainermikecovlee
Model Typetinymixtral
Model Files  1.9 GB
Supported Languagesen
Model ArchitectureTinyMixtralForCausalLM
Licensemit
Context Length2048
Model Max Length2048
Transformers Version5.17.0
Tokenizer ClassLlamaTokenizer
Padding Token</s>
Vocabulary Size32000