LLM EXPLORER 60,828 MODELS INDEXED

Gravity 30B A5B Base by trillionlabs

By trillionlabs · 257 downloads
HF Repo ↗ Copy URL

Gravity 30B A5B Base is an open-source language model by trillionlabs. Features: 30b LLM, VRAM: 59.2GB, Context: 128K, License: apache-2.0, LLM Explorer Score: 0.31.

  Arxiv:2401.02415   Arxiv:2412.19437   Base   Custom code   En   Gravity   Gravity moe   Ko   Mixture-of-experts   Moe   Pretrained   Region:us   Safetensors   Sharded   Tensorflow   Trillion-labs
Model Card on HF 🤗: https://huggingface.co/trillionlabs/Gravity-30B-A5B-Base 

Gravity 30B A5B Base Parameters and Internals

LLM NameGravity 30B A5B Base
Repository 🤗https://huggingface.co/trillionlabs/Gravity-30B-A5B-Base 
Model Size30b
Required VRAM59.2 GB
Updated2026-09-10
Maintainertrillionlabs
Model Typegravity_moe
Model Files  5.0 GB: 1-of-12   5.0 GB: 2-of-12   5.0 GB: 3-of-12   5.0 GB: 4-of-12   5.0 GB: 5-of-12   5.0 GB: 6-of-12   5.0 GB: 7-of-12   5.0 GB: 8-of-12   5.0 GB: 9-of-12   5.0 GB: 10-of-12   5.0 GB: 11-of-12   4.2 GB: 12-of-12
Supported Languagesen ko
Model ArchitectureGravityMoEForCausalLM
Licenseapache-2.0
Context Length131072
Model Max Length131072
Transformers Version4.57.1
Tokenizer ClassPreTrainedTokenizerFast
Padding Token<|begin_of_video|>
Vocabulary Size151552
Torch Data Typebfloat16