What are the hardware requirements for Mix TinyLlama 3x1B Oasst2 ChatML Cluster 3 2 1 V1?

Mix TinyLlama 3x1B Oasst2 ChatML Cluster 3 2 1 V1 requires approximately 5.2 GB of VRAM and supports a context window of 4K tokens. Quantized variants may run on less VRAM; see the Quantized Models section on this page.

Who developed Mix TinyLlama 3x1B Oasst2 ChatML Cluster 3 2 1 V1 and how large is it?

Mix TinyLlama 3x1B Oasst2 ChatML Cluster 3 2 1 V1 is developed by NickyNicky, a model with 2.6b parameters. The model is published as open weights on Hugging Face and indexed on LLM Explorer with full benchmark history.

Where can I download or evaluate Mix TinyLlama 3x1B Oasst2 ChatML Cluster 3 2 1 V1?

Mix TinyLlama 3x1B Oasst2 ChatML Cluster 3 2 1 V1 is hosted on Hugging Face and linked from this page. LLM Explorer also lists quantized variants and similar alternatives if available.

Mix TinyLlama 3x1B Oasst2 ChatML Cluster 3 2 1 V1 by NickyNicky — VRAM 5.2GB, 4K context

Name: Mix TinyLlama 3x1B Oasst2 ChatML Cluster 3 2 1 V1
Author: NickyNicky

Mix TinyLlama 3x1B Oasst2 ChatML Cluster 3 2 1 V1 is an open-source language model by NickyNicky. Features: 2.6b LLM, VRAM: 5.2GB, Context: 4K, License: apache-2.0, MoE, LLM Explorer Score: 0.11.

Ar Bn Ca Cs Da De En Endpoints compatible Eo Es Eu Fi Fr He Hu Id It Ja Ko Merge Mixtral Moe Nl Pl Region:us Ru Safetensors Sharded Sv Tensorflow Th Tr Vi Zh

Model Card on HF 🤗: https://huggingface.co/NickyNicky/Mix_TinyLlama-3x1B_oasst2_chatML_Cluster_3_2_1_V1

Mix TinyLlama 3x1B Oasst2 ChatML Cluster 3 2 1 V1 Parameters and Internals

Model Type

Causal Language Model

Additional Notes

The model MixLlama is derived from TinyDolphin models using different clusters and gating mechanics.

Supported Languages

languages_supported (Multi-language (en, es, ru, zh, de, fr, th, ca, it, ja, pl, eo, eu, vi, fi, hu, ar, nl, da, tr, ko, he, id, cs, bn, sv))

Training Details

Hardware Used:

GPU

Input Output

Input Format:

Text prompt with special tokens.

Accepted Modalities:

Text

Output Format:

Generated text with special tokens.

Performance Tips:

Use CUDA for better performance.

LLM Name	Mix TinyLlama 3x1B Oasst2 ChatML Cluster 3 2 1 V1
Repository 🤗	https://huggingface.co/NickyNicky/Mix_TinyLlama-3x1B_oasst2_chatML_Cluster_3_2_1_V1
Model Size	2.6b
Required VRAM	5.2 GB
Updated	2026-08-08
Maintainer	NickyNicky
Model Type	mixtral
Model Files	5.0 GB: 1-of-2 0.2 GB: 2-of-2
Supported Languages	en es ru zh de fr th ca it ja pl eo eu vi fi hu ar nl da tr ko he id cs bn sv
Model Architecture	MixtralForCausalLM
License	apache-2.0
Context Length	4096
Model Max Length	4096
Transformers Version	4.37.1
Tokenizer Class	LlamaTokenizer
Padding Token	<s>
Vocabulary Size	32002
Torch Data Type	bfloat16

Rank the Mix TinyLlama 3x1B Oasst2 ChatML Cluster 3 2 1 V1 capabilities

Have you tried this model? Rate its performance — this feedback helps the ML community find the right model for their needs.

Instruction Following and Task Automation
Factuality and Completeness of Knowledge
Censorship and Alignment
Data Analysis and Insight Generation
Text Generation
Text Summarization and Feature Extraction
Code Generation
Multi-Language Support and Translation

Best Alternatives to Mix TinyLlama 3x1B Oasst2 ChatML Cluster 3 2 1 V1

Best Alternatives	Context / RAM	Downloads	Likes
TinyExperts V0 4x1B	32K / 5.2 GB	1298	0
...oE 2.6B A0.6B Instruct Preview	4K / 5.2 GB	1764	11
Aquif 3.5 A0.6B Preview	4K / 5.2 GB	17	0
EuroMoE 2.6B A0.6B 2512	4K / 5.2 GB	139	11
TinyEnsemble 3x1.1B TinyMoE	4K / 5.3 GB	6	0
...x MoE Samantha Chatml Therabot	4K / 5.2 GB	11	1
LiteLlamix 8x460M 1T	1K / 5.2 GB	9	4

Note: green Score (e.g. "73.2") means that the model is better than NickyNicky/Mix_TinyLlama-3x1B_oasst2_chatML_Cluster_3_2_1_V1.