LLM EXPLORER 57,252 MODELS INDEXED

Dots.llm1.inst Mixed 4 6bit by mlx-community

By mlx-community · 33 downloads
HF Repo ↗ Copy URL

Dots.llm1.inst Mixed 4 6bit is an open-source language model by mlx-community. Features: 142.8b LLM, VRAM: 86GB, Context: 32K, License: mit, Quantized, LLM Explorer Score: 0.19.

  4-bit   6bit Base model:quantized:rednote-h... Base model:rednote-hilab/dots....   Chat   Conversational   Dots1   En   Mlx   Quantized   Region:us   Safetensors   Sharded   Tensorflow   Zh
Model Card on HF 🤗: https://huggingface.co/mlx-community/dots.llm1.inst-mixed-4-6bit 

Dots.llm1.inst Mixed 4 6bit Parameters and Internals

LLM NameDots.llm1.inst Mixed 4 6bit
Repository 🤗https://huggingface.co/mlx-community/dots.llm1.inst-mixed-4-6bit 
Base Model(s)  rednote-hilab/dots.llm1.inst   rednote-hilab/dots.llm1.inst
Model Size142.8b
Required VRAM86 GB
Updated2026-06-21
Maintainermlx-community
Model Typedots1
Model Files  5.0 GB: 1-of-17   5.3 GB: 2-of-17   5.4 GB: 3-of-17   5.0 GB: 4-of-17   5.2 GB: 5-of-17   5.4 GB: 6-of-17   5.3 GB: 7-of-17   5.0 GB: 8-of-17   5.2 GB: 9-of-17   5.4 GB: 10-of-17   5.0 GB: 11-of-17   4.9 GB: 12-of-17   5.2 GB: 13-of-17   5.4 GB: 14-of-17   5.4 GB: 15-of-17   5.3 GB: 16-of-17   2.6 GB: 17-of-17
Supported Languagesen zh
Quantization Type6bit
Model ArchitectureDots1ForCausalLM
Licensemit
Context Length32768
Model Max Length32768
Transformers Version4.46.3
Tokenizer ClassQwen2Tokenizer
Padding Token<|endofresponse|>
Vocabulary Size152064
Torch Data Typebfloat16
Errorsreplace