LLM EXPLORER 61,836 MODELS INDEXED

Oguz MoE 354M Base by Yigit-Karaman

By Yigit-Karaman · 126 downloads

Oguz MoE 354M Base is an open-source language model by Yigit-Karaman. Features: 354.2m LLM, VRAM: 0.7GB, Context: 2K, License: apache-2.0, MoE, LLM Explorer Score: 0.31.

  Base-model   Custom-code   Custom code Dataset:huggingfacefw/fineweb-... Dataset:ytu-ce-cosmos/cosmos-t...   Depth-upscaling   Llama   Mixture-of-experts   Moe   Moe llama   Region:us   Safetensors   Tr   Turkish   Upcycled

Oguz MoE 354M Base Parameters and Internals

LLM NameOguz MoE 354M Base
Repository πŸ€—https://huggingface.co/Yigit-Karaman/Oguz-MoE-354M-Base 
Model Size354.2m
Required VRAM0.7 GB
Updated2026-09-21
MaintainerYigit-Karaman
Model Typemoe_llama
Model Files  0.7 GB
Supported Languagestr
Model ArchitectureMoeLlamaForCausalLM
Licenseapache-2.0
Context Length2048
Model Max Length2048
Tokenizer ClassGPT2Tokenizer
Vocabulary Size50257
Errorsreplace