LLM EXPLORER 68,069 MODELS INDEXED

Snowball 67B A2B 5.7T Mixed RLVR Step38 by open-athena

By open-athena · 223 downloads

Snowball 67B A2B 5.7T Mixed RLVR Step38 is an open-source language model by open-athena. Features: 67b LLM, VRAM: 133.9GB, Context: 32K, LLM Explorer Score: 0.26.

Base model:finetune:laion/snow... Base model:laion/snowball-67b-...   Grug moe   Megatron   Mixture-of-experts   Region:us   Rlvr   Safetensors   Sharded   Tensorflow

Snowball 67B A2B 5.7T Mixed RLVR Step38 Parameters and Internals

LLM NameSnowball 67B A2B 5.7T Mixed RLVR Step38
Repository πŸ€—https://huggingface.co/open-athena/Snowball-67B-A2B-5.7T-Mixed-RLVR-Step38 
Base Model(s)  laion/snowball-67b-a2b-sft-s3-nemotron-terminal-step1888   laion/snowball-67b-a2b-sft-s3-nemotron-terminal-step1888
Model Size67b
Required VRAM133.9 GB
Updated2026-10-06
Maintaineropen-athena
Model Typegrug_moe
Model Files  4.7 GB: 1-of-39   3.4 GB: 2-of-39   3.4 GB: 3-of-39   3.4 GB: 4-of-39   3.4 GB: 5-of-39   3.4 GB: 6-of-39   3.4 GB: 7-of-39   3.4 GB: 8-of-39   3.4 GB: 9-of-39   3.4 GB: 10-of-39   3.4 GB: 11-of-39   3.4 GB: 12-of-39   3.4 GB: 13-of-39   3.4 GB: 14-of-39   3.4 GB: 15-of-39   3.4 GB: 16-of-39   3.4 GB: 17-of-39   3.4 GB: 18-of-39   3.4 GB: 19-of-39   3.4 GB: 20-of-39   3.4 GB: 21-of-39   3.4 GB: 22-of-39   3.4 GB: 23-of-39   3.4 GB: 24-of-39   3.4 GB: 25-of-39   3.4 GB: 26-of-39   3.4 GB: 27-of-39   3.4 GB: 28-of-39   3.4 GB: 29-of-39   3.4 GB: 30-of-39   3.4 GB: 31-of-39   3.4 GB: 32-of-39   3.4 GB: 33-of-39   3.4 GB: 34-of-39   3.4 GB: 35-of-39   3.4 GB: 36-of-39   3.4 GB: 37-of-39   3.4 GB: 38-of-39   3.4 GB: 39-of-39
Model ArchitectureGrugMoeForCausalLM
Context Length32768
Model Max Length32768
Transformers Version5.16.1
Tokenizer ClassPreTrainedTokenizerFast
Padding Token<|end_of_text|>
Vocabulary Size128256

Best Alternatives to Snowball 67B A2B 5.7T Mixed RLVR Step38

Best Alternatives
Context / RAM
Downloads
Likes
...A2B 10T Mixed RLVR Sync Step92256K / 79.3 GB12580
...ign3 DARE Linear 02 2026.10.12256K / 134 GB4811
Grug 67B A2B BFCL Recovery256K / 133.9 GB4650
...tidoom RLVR1 Step12 2026.10.02256K / 134 GB4140
...it SFT 262K 2026.09.21 Dr Doom256K / 113.6 GB4150
...rug 67B A2B BFCL Protocol FTPO256K / 134 GB2321
...2B Datakit SFT 262K 2026.09.21256K / 133.9 GB4670
...owball 67B A2b Base 262K Qk175256K / 133.9 GB6230
...paign2 DARE TIES 02 2026.10.10256K / 134 GB1570
...2B Datakit SFT 262K 2026.09.11256K / 70.6 GB3391
Note: green Score (e.g. "73.2") means that the model is better than open-athena/Snowball-67B-A2B-5.7T-Mixed-RLVR-Step38.