LLM EXPLORER 67,808 MODELS INDEXED

Gemma 4 26B A4B SFT EchoMoE Teacher by McGill-NLP

By McGill-NLP · 343 downloads

Gemma 4 26B A4B SFT EchoMoE Teacher is an open-source language model by McGill-NLP. Features: 26b LLM, VRAM: 50.9GB, Context: 256K, License: apache-2.0, Instruction-Based.

  Arxiv:2611.22215 Base model:finetune:google/gem... Base model:google/gemma-4-26b-...   Conversational Dataset:allenai/dolci-instruct...   Echomoe   En   Endpoints compatible   Gemma4   Gemma4 text   Instruct   Mixture-of-experts   Region:us   Safetensors   Sharded   Tensorflow

Gemma 4 26B A4B SFT EchoMoE Teacher Parameters and Internals

LLM NameGemma 4 26B A4B SFT EchoMoE Teacher
Repository πŸ€—https://huggingface.co/McGill-NLP/Gemma-4-26B-A4B-SFT-EchoMoE-teacher 
Base Model(s)  Gemma 4 26B A4B   google/gemma-4-26B-A4B
Model Size26b
Required VRAM50.9 GB
Updated2026-11-19
MaintainerMcGill-NLP
Model Typegemma4_text
Instruction-BasedYes
Model Files  3.6 GB: 1-of-15   3.3 GB: 2-of-15   3.2 GB: 3-of-15   3.3 GB: 4-of-15   3.9 GB: 5-of-15   3.8 GB: 6-of-15   3.3 GB: 7-of-15   3.9 GB: 8-of-15   3.8 GB: 9-of-15   3.3 GB: 10-of-15   3.9 GB: 11-of-15   3.8 GB: 12-of-15   3.3 GB: 13-of-15   3.9 GB: 14-of-15   0.6 GB: 15-of-15
Supported Languagesen
Model ArchitectureGemma4ForCausalLM
Licenseapache-2.0
Context Length262144
Model Max Length262144
Transformers Version5.8.1
Tokenizer ClassGemmaTokenizer
Padding Token<pad>
Vocabulary Size262144