LiteLlamix 8x460M 1T is an open-source language model by aloobun. Features: 2.6b LLM, VRAM: 5.2GB, Context: 1K, License: apache-2.0, MoE, LLM Explorer Score: 0.1.
| LLM Name | LiteLlamix 8x460M 1T |
| Repository π€ | https://huggingface.co/aloobun/LiteLlamix-8x460M-1T |
| Model Size | 2.6b |
| Required VRAM | 5.2 GB |
| Updated | 2026-06-29 |
| Maintainer | aloobun |
| Model Type | mixtral |
| Model Files | |
| Model Architecture | MixtralForCausalLM |
| License | apache-2.0 |
| Context Length | 1024 |
| Model Max Length | 1024 |
| Transformers Version | 4.36.2 |
| Tokenizer Class | GPT2Tokenizer |
| Padding Token | <|endoftext|> |
| Vocabulary Size | 50304 |
| Torch Data Type | bfloat16 |
| Errors | replace |
Best Alternatives |
Context / RAM |
Downloads |
Likes |
|---|---|---|---|
| TinyExperts V0 4x1B | 32K / 5.2 GB | 1298 | 0 |
| ...oE 2.6B A0.6B Instruct Preview | 4K / 5.2 GB | 1764 | 11 |
| Aquif 3.5 A0.6B Preview | 4K / 5.2 GB | 17 | 0 |
| EuroMoE 2.6B A0.6B 2512 | 4K / 5.2 GB | 139 | 11 |
| TinyEnsemble 3x1.1B TinyMoE | 4K / 5.3 GB | 6 | 0 |
| ...x MoE Samantha Chatml Therabot | 4K / 5.2 GB | 11 | 1 |
| ...Oasst2 ChatML Cluster 3 2 1 V1 | 4K / 5.2 GB | 6 | 3 |