LLM EXPLORER 61,405 MODELS INDEXED

Maba V1.5 Exp Architecture by AndrewThompson1233

By AndrewThompson1233 · 943 downloads
HF Repo ↗ Copy URL

Maba V1.5 Exp Architecture is an open-source language model by AndrewThompson1233. Features: 100m LLM, Context: 4K, License: mit, LLM Explorer Score: 0.35.

  100m   1b   3-stream   30b   3b   7b   Architecture   Centroid-indexing Decoupled-gated-delta-attentio...   Dg-indexer   Dgda   En   Endpoints compatible   Hca   Linear-attention   Linear-recurrence   Maba   Maba-sa   Maba-v1.5   Maba-v1.5-exp   Maba sparse   Mla   Mtp   Multi-head-latent-attention   Multi-token-prediction   Nope   Pytorch   Recurrent   Region:us   Rmsnorm   Scaling   Sparse-attention   Speculative-decoding   Swiglu
Model Card on HF 🤗: https://huggingface.co/AndrewThompson1233/maba-v1.5-exp-architecture 

Maba V1.5 Exp Architecture Parameters and Internals

LLM NameMaba V1.5 Exp Architecture
Repository 🤗https://huggingface.co/AndrewThompson1233/maba-v1.5-exp-architecture 
Model Size100m
Updated2026-09-16
MaintainerAndrewThompson1233
Model Typemaba_sparse
Supported Languagesen
Model ArchitectureMabaSparseForCausalLM
Licensemit
Context Length4096
Model Max Length4096
Transformers Version4.49.0
Vocabulary Size32768
Torch Data Typefloat32