LLM EXPLORER 59,766 MODELS INDEXED

Flex Code 2x7B 1T by allenai

By allenai · 159 downloads
HF Repo ↗ Copy URL

Flex Code 2x7B 1T is an open-source language model by allenai. Features: 11.6b LLM, VRAM: 46.8GB, Context: 4K, License: apache-2.0, MoE, LLM Explorer Score: 0.19.

  Arxiv:2507.00000   Co2 eq emissions   Conversational   En   Endpoints compatible   Flex olmo   Flexolmo   Moe   Olmo   Region:us   Safetensors   Sharded   Tensorflow
Model Card on HF 🤗: https://huggingface.co/allenai/Flex-code-2x7B-1T 

Flex Code 2x7B 1T Parameters and Internals

LLM NameFlex Code 2x7B 1T
Repository 🤗https://huggingface.co/allenai/Flex-code-2x7B-1T 
Model Size11.6b
Required VRAM46.8 GB
Updated2026-08-06
Maintainerallenai
Model Typeflex_olmo
Model Files  5.0 GB: 1-of-10   5.0 GB: 2-of-10   4.8 GB: 3-of-10   4.9 GB: 4-of-10   5.0 GB: 5-of-10   4.9 GB: 6-of-10   4.9 GB: 7-of-10   5.0 GB: 8-of-10   4.9 GB: 9-of-10   2.4 GB: 10-of-10
Supported Languagesen
Model ArchitectureFlexOlmoForCausalLM
Licenseapache-2.0
Context Length4096
Model Max Length4096
Transformers Version4.50.0.dev0
Tokenizer ClassGPT2Tokenizer
Padding Token<|pad|>
Vocabulary Size100352
Torch Data Typefloat32

Best Alternatives to Flex Code 2x7B 1T

Best Alternatives
Context / RAM
Downloads
Likes
BAR 2x7B Math64K / 23.3 GB1302
BAR 2x7B Code64K / 23.3 GB983
BAR 2x7B Base64K / 23.3 GB861
BAR 2x7B Code SFT64K / 23.3 GB683
BAR 2x7B Math SFT64K / 23.3 GB512
BAR 2x7B Tool Use64K / 23.3 GB431
Flex Reddit 2x7B 1T4K / 46.8 GB109699
Flex Math 2x7B 1T4K / 46.8 GB1284
Flex Pes2o 2x7B 1T4K / 46.8 GB1033
Flex News 2x7B 1T4K / 46.8 GB934
Note: green Score (e.g. "73.2") means that the model is better than allenai/Flex-code-2x7B-1T.