LLM EXPLORER 65,695 MODELS INDEXED

Flint Mixed 3 4bit by mlx-community

By mlx-community · 1609 downloads

Flint Mixed 3 4bit is an open-source language model by mlx-community. Features: 39.8b LLM, VRAM: 17.9GB, Context: 256K, License: apache-2.0, Quantized, LLM Explorer Score: 0.35.

  24gb   3-bit   32gb   4-bit   4bit   Apple-silicon Base model:quantized:recursive... Base model:recursivesi/flint-i...   Code   Coding-agent   Conversational   Flint   Mac   Mlx   Moe   Quantized   Region:us   Safetensors   Sharded   Tensorflow

Flint Mixed 3 4bit Parameters and Internals

LLM NameFlint Mixed 3 4bit
Repository πŸ€—https://huggingface.co/mlx-community/flint-mixed-3-4bit 
Base Model(s)  Flint Int4   RecursiveSI/flint-int4
Model Size39.8b
Required VRAM17.9 GB
Updated2026-10-26
Maintainermlx-community
Model Typeflint
Model Files  5.3 GB: 1-of-4   5.4 GB: 2-of-4   5.3 GB: 3-of-4   1.9 GB: 4-of-4
Quantization Type4bit
Model ArchitectureFlintForCausalLM
Licenseapache-2.0
Context Length262144
Model Max Length262144
Tokenizer ClassPreTrainedTokenizerFast
Vocabulary Size150144
Torch Data Typebfloat16

Best Alternatives to Flint Mixed 3 4bit

Best Alternatives
Context / RAM
Downloads
Likes
Flint MLX Serve 4bit256K / 22.5 GB19502
Flint MLX Serve Mixed 4 8bit256K / 23.4 GB12303
Flint Mixed 3 4bit256K / 17.9 GB1931
Flint256K / 80 GB4795754
Flint AWQ256K / 0.9 GB881
Flint FP8 BF16256K / 0.8 GB461
Note: green Score (e.g. "73.2") means that the model is better than mlx-community/flint-mixed-3-4bit.