LLM EXPLORER 63,197 MODELS INDEXED

Snowball 67B A2B 5.7T Mixed RLVR Step38 by open-athena

By open-athena · 223 downloads
HF Repo ↗ Copy URL

Snowball 67B A2B 5.7T Mixed RLVR Step38 is an open-source language model by open-athena. Features: 67b LLM, VRAM: 133.9GB, Context: 32K, LLM Explorer Score: 0.28.

Base model:finetune:laion/snow... Base model:laion/snowball-67b-...   Grug moe   Megatron   Mixture-of-experts   Region:us   Rlvr   Safetensors   Sharded   Tensorflow
Model Card on HF 🤗: https://huggingface.co/open-athena/Snowball-67B-A2B-5.7T-Mixed-RLVR-Step38 

Snowball 67B A2B 5.7T Mixed RLVR Step38 Parameters and Internals

LLM NameSnowball 67B A2B 5.7T Mixed RLVR Step38
Repository 🤗https://huggingface.co/open-athena/Snowball-67B-A2B-5.7T-Mixed-RLVR-Step38 
Base Model(s)  laion/snowball-67b-a2b-sft-s3-nemotron-terminal-step1888   laion/snowball-67b-a2b-sft-s3-nemotron-terminal-step1888
Model Size67b
Required VRAM133.9 GB
Updated2026-10-06
Maintaineropen-athena
Model Typegrug_moe
Model Files  4.7 GB: 1-of-39   3.4 GB: 2-of-39   3.4 GB: 3-of-39   3.4 GB: 4-of-39   3.4 GB: 5-of-39   3.4 GB: 6-of-39   3.4 GB: 7-of-39   3.4 GB: 8-of-39   3.4 GB: 9-of-39   3.4 GB: 10-of-39   3.4 GB: 11-of-39   3.4 GB: 12-of-39   3.4 GB: 13-of-39   3.4 GB: 14-of-39   3.4 GB: 15-of-39   3.4 GB: 16-of-39   3.4 GB: 17-of-39   3.4 GB: 18-of-39   3.4 GB: 19-of-39   3.4 GB: 20-of-39   3.4 GB: 21-of-39   3.4 GB: 22-of-39   3.4 GB: 23-of-39   3.4 GB: 24-of-39   3.4 GB: 25-of-39   3.4 GB: 26-of-39   3.4 GB: 27-of-39   3.4 GB: 28-of-39   3.4 GB: 29-of-39   3.4 GB: 30-of-39   3.4 GB: 31-of-39   3.4 GB: 32-of-39   3.4 GB: 33-of-39   3.4 GB: 34-of-39   3.4 GB: 35-of-39   3.4 GB: 36-of-39   3.4 GB: 37-of-39   3.4 GB: 38-of-39   3.4 GB: 39-of-39
Model ArchitectureGrugMoeForCausalLM
Context Length32768
Model Max Length32768
Transformers Version5.16.1
Tokenizer ClassPreTrainedTokenizerFast
Padding Token<|end_of_text|>
Vocabulary Size128256

Best Alternatives to Snowball 67B A2B 5.7T Mixed RLVR Step38

Best Alternatives
Context / RAM
Downloads
Likes
...it SFT 262K 2026.09.21 Dr Doom256K / 113.6 GB4150
...2B Datakit SFT 262K 2026.09.21256K / 133.9 GB4670
... A2B GLM53 RLVR SFT 2026.09.23256K / 146.8 GB1910
...2B Datakit SFT 262K 2026.09.11256K / 70.6 GB3391
...7B A2b Sft S2 Thinking Step63064K / 133.9 GB3500
...7B A2b Sft S1 Wildchat Step25764K / 133.9 GB2330
Note: green Score (e.g. "73.2") means that the model is better than open-athena/Snowball-67B-A2B-5.7T-Mixed-RLVR-Step38.