LLM EXPLORER 61,060 MODELS INDEXED

Maba V1 Architecture by AndrewThompson1233

By AndrewThompson1233 · 1058 downloads

Maba V1 Architecture is an open-source language model by AndrewThompson1233. Features: 100m LLM, Context: 4K, License: mit.

  100m   1b   30b   3b   7b   Architecture   Avx2   Cpp   En   Endpoints compatible   Gated-deltanet   Gdn   Gdn-2   Gqa   Grouped-query-attention   Linear-attention   Linear-recurrence   Maba   Maba-v1   Maba-v1.1   Mtp   Multi-token-prediction   Pytorch   Recurrent   Region:us   Rmsnorm   Rope   Safetensors   Scaling   Speculative-decoding   Ssm   State-space-model   Swiglu

Maba V1 Architecture Parameters and Internals

LLM NameMaba V1 Architecture
Repository πŸ€—https://huggingface.co/AndrewThompson1233/maba-v1-architecture 
Model Size100m
Updated2026-09-14
MaintainerAndrewThompson1233
Model Typemaba
Supported Languagesen
Model ArchitectureMabaModel
Licensemit
Context Length4096
Model Max Length4096
Transformers Version4.49.0
Vocabulary Size32768
Torch Data Typefloat32