LLM EXPLORER 56,604 MODELS INDEXED

LiteLlamix 8x460M 1T by aloobun

By aloobun · 9 downloads

LiteLlamix 8x460M 1T is an open-source language model by aloobun. Features: 2.6b LLM, VRAM: 5.2GB, Context: 1K, License: apache-2.0, MoE, LLM Explorer Score: 0.1.

  Ahxt/litellama-460m-1t   Endpoints compatible   Lazymergekit   Llama2   Merge   Mergekit   Mixtral   Moe   Region:us   Safetensors   Sharded   Tensorflow

LiteLlamix 8x460M 1T Parameters and Internals

LLM NameLiteLlamix 8x460M 1T
Repository πŸ€—https://huggingface.co/aloobun/LiteLlamix-8x460M-1T 
Model Size2.6b
Required VRAM5.2 GB
Updated2026-06-29
Maintaineraloobun
Model Typemixtral
Model Files  5.2 GB: 1-of-1
Model ArchitectureMixtralForCausalLM
Licenseapache-2.0
Context Length1024
Model Max Length1024
Transformers Version4.36.2
Tokenizer ClassGPT2Tokenizer
Padding Token<|endoftext|>
Vocabulary Size50304
Torch Data Typebfloat16
Errorsreplace

Best Alternatives to LiteLlamix 8x460M 1T

Best Alternatives
Context / RAM
Downloads
Likes
TinyExperts V0 4x1B32K / 5.2 GB12980
...oE 2.6B A0.6B Instruct Preview4K / 5.2 GB176411
Aquif 3.5 A0.6B Preview4K / 5.2 GB170
EuroMoE 2.6B A0.6B 25124K / 5.2 GB13911
TinyEnsemble 3x1.1B TinyMoE4K / 5.3 GB60
...x MoE Samantha Chatml Therabot4K / 5.2 GB111
...Oasst2 ChatML Cluster 3 2 1 V14K / 5.2 GB63
Note: green Score (e.g. "73.2") means that the model is better than aloobun/LiteLlamix-8x460M-1T.