LLM EXPLORER 58,608 MODELS INDEXED

Gravity 16B A3B Base by trillionlabs

By trillionlabs · 638 downloads
HF Repo ↗ Copy URL

Gravity 16B A3B Base is an open-source language model by trillionlabs. Features: 16b LLM, VRAM: 32.4GB, Context: 32K, License: apache-2.0, LLM Explorer Score: 0.26.

  Arxiv:2412.19437   Arxiv:2502.16982   Base   Custom code   En   Gravity   Gravity moe   Ko   Mixture-of-experts   Moe   Pretrained   Region:us   Safetensors   Sharded   Tensorflow   Trillion-labs
Model Card on HF 🤗: https://huggingface.co/trillionlabs/Gravity-16B-A3B-Base 

Gravity 16B A3B Base Parameters and Internals

LLM NameGravity 16B A3B Base
Repository 🤗https://huggingface.co/trillionlabs/Gravity-16B-A3B-Base 
Model Size16b
Required VRAM32.4 GB
Updated2026-07-10
Maintainertrillionlabs
Model Typegravity_moe
Model Files  10.7 GB: 1-of-4   10.7 GB: 2-of-4   10.4 GB: 3-of-4   0.6 GB: 4-of-4
Supported Languagesen ko
Model ArchitectureGravityMoEForCausalLM
Licenseapache-2.0
Context Length32768
Model Max Length32768
Tokenizer ClassPreTrainedTokenizerFast
Padding Token<|endoftext|>
Vocabulary Size151552
Torch Data Typebfloat16

Best Alternatives to Gravity 16B A3B Base

Best Alternatives
Context / RAM
Downloads
Likes
L1 16B A3B32K / 32.5 GB118514
Note: green Score (e.g. "73.2") means that the model is better than trillionlabs/Gravity-16B-A3B-Base.