LLM EXPLORER 63,892 MODELS INDEXED

Grug 67B A2B Antidoom RLVR1 Reference KL Step20 2026.10.04 by open-athena

By open-athena · 107 downloads
HF Repo ↗ Copy URL

Grug 67B A2B Antidoom RLVR1 Reference KL Step20 2026.10.04 is an open-source language model by open-athena. Features: 67b LLM, VRAM: 134GB, Context: 256K, License: openmdw-1.1, LLM Explorer Score: 0.28.

  Conversational   Endpoints compatible   Grug moe   Moe   Region:us   Rlvr   Safetensors   Sharded   Snowball   Tensorflow
Model Card on HF 🤗: https://huggingface.co/open-athena/Grug-67B-A2B-Antidoom-RLVR1-Reference-KL-Step20-2026.10.04 

Grug 67B A2B Antidoom RLVR1 Reference KL Step20 2026.10.04 Parameters and Internals

LLM NameGrug 67B A2B Antidoom RLVR1 Reference KL Step20 2026.10.04
Repository 🤗https://huggingface.co/open-athena/Grug-67B-A2B-Antidoom-RLVR1-Reference-KL-Step20-2026.10.04 
Model Size67b
Required VRAM134 GB
Updated2026-10-12
Maintaineropen-athena
Model Typegrug_moe
Model Files  4.8 GB: 1-of-39   3.4 GB: 2-of-39   3.4 GB: 3-of-39   3.4 GB: 4-of-39   3.4 GB: 5-of-39   3.4 GB: 6-of-39   3.4 GB: 7-of-39   3.4 GB: 8-of-39   3.4 GB: 9-of-39   3.4 GB: 10-of-39   3.4 GB: 11-of-39   3.4 GB: 12-of-39   3.4 GB: 13-of-39   3.4 GB: 14-of-39   3.4 GB: 15-of-39   3.4 GB: 16-of-39   3.4 GB: 17-of-39   3.4 GB: 18-of-39   3.4 GB: 19-of-39   3.4 GB: 20-of-39   3.4 GB: 21-of-39   3.4 GB: 22-of-39   3.4 GB: 23-of-39   3.4 GB: 24-of-39   3.4 GB: 25-of-39   3.4 GB: 26-of-39   3.4 GB: 27-of-39   3.4 GB: 28-of-39   3.4 GB: 29-of-39   3.4 GB: 30-of-39   3.4 GB: 31-of-39   3.4 GB: 32-of-39   3.4 GB: 33-of-39   3.4 GB: 34-of-39   3.4 GB: 35-of-39   3.4 GB: 36-of-39   3.4 GB: 37-of-39   3.4 GB: 38-of-39   3.4 GB: 39-of-39
Model ArchitectureGrugMoeForCausalLM
Licenseopenmdw-1.1
Context Length262144
Model Max Length262144
Transformers Version5.16.1
Tokenizer ClassPreTrainedTokenizerFast
Padding Token<|end_of_text|>
Vocabulary Size128256

Best Alternatives to Grug 67B A2B Antidoom RLVR1 Reference KL Step20 2026.10.04

Best Alternatives
Context / RAM
Downloads
Likes
...A2B 10T Mixed RLVR Sync Step92256K / 79.3 GB12580
...tidoom RLVR1 Step12 2026.10.02256K / 134 GB4140
...it SFT 262K 2026.09.21 Dr Doom256K / 113.6 GB4150
...2B Datakit SFT 262K 2026.09.21256K / 133.9 GB4670
...2B Datakit SFT 262K 2026.09.11256K / 70.6 GB3391
... A2B GLM53 RLVR SFT 2026.09.23256K / 146.8 GB1910
...7B A2b Sft S2 Thinking Step63064K / 133.9 GB3500
...7B A2b Sft S1 Wildchat Step25764K / 133.9 GB2330
...67B A2B 5.7T Mixed RLVR Step3832K / 133.9 GB2230
Note: green Score (e.g. "73.2") means that the model is better than open-athena/Grug-67B-A2B-Antidoom-RLVR1-Reference-KL-Step20-2026.10.04.