LLM EXPLORER 60,645 MODELS INDEXED

Superthoughts Lite V2 MoE Llama3.2 Experimental 0427 by Pinkstack

By Pinkstack · 11 downloads

Superthoughts Lite V2 MoE Llama3.2 Experimental 0427 is an open-source language model by Pinkstack. Features: 3.9b LLM, VRAM: 7.9GB, Context: 128K, License: llama3.2, MoE, Instruction-Based, LLM Explorer Score: 0.18.

Base model:finetune:meta-llama... Base model:meta-llama/llama-3....   Code   Conversational   Cot   En   Endpoints compatible   Instruct   Math   Mixtral   Moe   Region:us   Safetensors   Sharded   Superthoughts   Tensorflow

Superthoughts Lite V2 MoE Llama3.2 Experimental 0427 Parameters and Internals

LLM NameSuperthoughts Lite V2 MoE Llama3.2 Experimental 0427
Repository πŸ€—https://huggingface.co/Pinkstack/Superthoughts-lite-v2-MOE-Llama3.2-experimental-0427 
Base Model(s)  meta-llama/Llama-3.2-1B-Instruct   meta-llama/Llama-3.2-1B-Instruct
Model Size3.9b
Required VRAM7.9 GB
Updated2026-07-15
MaintainerPinkstack
Model Typemixtral
Instruction-BasedYes
Model Files  1.0 GB: 1-of-8   1.0 GB: 2-of-8   1.0 GB: 3-of-8   1.0 GB: 4-of-8   1.0 GB: 5-of-8   1.0 GB: 6-of-8   1.0 GB: 7-of-8   0.9 GB: 8-of-8
Supported Languagesen
Model ArchitectureMixtralForCausalLM
Licensellama3.2
Context Length131072
Model Max Length131072
Transformers Version4.51.3
Tokenizer ClassPreTrainedTokenizer
Padding Token<|begin_of_text|>
Vocabulary Size128256
Torch Data Typefloat16