LLM EXPLORER 64,561 MODELS INDEXED

Grug 67B A2B Merge Campaign3 DARE Linear 02 2026.10.12 by open-athena

By open-athena · 481 downloads
HF Repo ↗ Copy URL

Grug 67B A2B Merge Campaign3 DARE Linear 02 2026.10.12 is an open-source language model by open-athena. Features: 67b LLM, VRAM: 134GB, Context: 256K, License: openmdw-1.1, Merged.

  Merged Model Base model:laion/snowball-67b-... Base model:open-athena/grug-67...   Conversational   Dare-linear   Endpoints compatible   Grug moe   Mixture-of-experts   Model-merging   Region:us   Safetensors   Sharded   Tensorflow
Model Card on HF 🤗: https://huggingface.co/open-athena/Grug-67B-A2B-Merge-Campaign3-DARE-Linear-02-2026.10.12 

Grug 67B A2B Merge Campaign3 DARE Linear 02 2026.10.12 Parameters and Internals

LLM NameGrug 67B A2B Merge Campaign3 DARE Linear 02 2026.10.12
Repository 🤗https://huggingface.co/open-athena/Grug-67B-A2B-Merge-Campaign3-DARE-Linear-02-2026.10.12 
Base Model(s)  open-athena/Grug-67B-A2B-Merge-Campaign2-DARE-TIES-02-2026.10.10   ...A2b Relay Sft Allkimi Step1203   open-athena/Grug-67B-A2B-Merge-Campaign2-DARE-TIES-02-2026.10.10   laion/snowball-67b-a2b-relay-sft-allkimi-step1203
Merged ModelYes
Model Size67b
Required VRAM134 GB
Updated2026-10-17
Maintaineropen-athena
Model Typegrug_moe
Model Files  4.8 GB: 1-of-39   3.4 GB: 2-of-39   3.4 GB: 3-of-39   3.4 GB: 4-of-39   3.4 GB: 5-of-39   3.4 GB: 6-of-39   3.4 GB: 7-of-39   3.4 GB: 8-of-39   3.4 GB: 9-of-39   3.4 GB: 10-of-39   3.4 GB: 11-of-39   3.4 GB: 12-of-39   3.4 GB: 13-of-39   3.4 GB: 14-of-39   3.4 GB: 15-of-39   3.4 GB: 16-of-39   3.4 GB: 17-of-39   3.4 GB: 18-of-39   3.4 GB: 19-of-39   3.4 GB: 20-of-39   3.4 GB: 21-of-39   3.4 GB: 22-of-39   3.4 GB: 23-of-39   3.4 GB: 24-of-39   3.4 GB: 25-of-39   3.4 GB: 26-of-39   3.4 GB: 27-of-39   3.4 GB: 28-of-39   3.4 GB: 29-of-39   3.4 GB: 30-of-39   3.4 GB: 31-of-39   3.4 GB: 32-of-39   3.4 GB: 33-of-39   3.4 GB: 34-of-39   3.4 GB: 35-of-39   3.4 GB: 36-of-39   3.4 GB: 37-of-39   3.4 GB: 38-of-39   3.4 GB: 39-of-39
Model ArchitectureGrugMoeForCausalLM
Licenseopenmdw-1.1
Context Length262144
Model Max Length262144
Transformers Version5.16.1
Vocabulary Size128256

Best Alternatives to Grug 67B A2B Merge Campaign3 DARE Linear 02 2026.10.12

Best Alternatives
Context / RAM
Downloads
Likes
Grug 67B A2B BFCL Recovery256K / 133.9 GB4650
...rug 67B A2B BFCL Protocol FTPO256K / 134 GB2321
...A2B 10T Mixed RLVR Sync Step92256K / 79.3 GB12580
...tidoom RLVR1 Step12 2026.10.02256K / 134 GB4140
...it SFT 262K 2026.09.21 Dr Doom256K / 113.6 GB4150
...2B Datakit SFT 262K 2026.09.21256K / 133.9 GB4670
...2B Datakit SFT 262K 2026.09.11256K / 70.6 GB3391
...Reference KL Step20 2026.10.04256K / 134 GB1070
... A2B GLM53 RLVR SFT 2026.09.23256K / 146.8 GB1910
...A2b Relay Sft Allkimi Step1203256K / 133.9 GB600
Note: green Score (e.g. "73.2") means that the model is better than open-athena/Grug-67B-A2B-Merge-Campaign3-DARE-Linear-02-2026.10.12.