LLM EXPLORER 65,695 MODELS INDEXED

Flint 40B A2.5B Abliterated MLX 4bit by dima6312

By dima6312 · 1187 downloads
HF Repo ↗ Copy URL

Flint 40B A2.5B Abliterated MLX 4bit is an open-source language model by dima6312. Features: 40b LLM, VRAM: 3.8GB, Context: 256K, License: apache-2.0, Quantized.

  Arxiv:2406.11717   4-bit   4bit   Abliterated Base model:dima6312/flint-40b-... Base model:quantized:dima6312/...   Code   Conversational   Cybersecurity Dataset:mlabonne/harmful behav... Dataset:mlabonne/harmless alpa...   En   Flint   Mlx   Moe   Quantized   Region:us   Safetensors   Uncensored
Model Card on HF 🤗: https://huggingface.co/dima6312/Flint-40B-A2.5B-abliterated-MLX-4bit 

Flint 40B A2.5B Abliterated MLX 4bit Parameters and Internals

LLM NameFlint 40B A2.5B Abliterated MLX 4bit
Repository 🤗https://huggingface.co/dima6312/Flint-40B-A2.5B-abliterated-MLX-4bit 
Base Model(s)  dima6312/Flint-40B-A2.5B-abliterated   dima6312/Flint-40B-A2.5B-abliterated
Model Size40b
Required VRAM3.8 GB
Updated2026-10-27
Maintainerdima6312
Model Typeflint
Model Files  4.8 GB   4.7 GB   4.7 GB   4.7 GB   3.8 GB
Supported Languagesen
Quantization Type4bit
Model ArchitectureFlintForCausalLM
Licenseapache-2.0
Context Length262144
Model Max Length262144
Tokenizer ClassPreTrainedTokenizerFast
Vocabulary Size150144
Torch Data Typebfloat16

Best Alternatives to Flint 40B A2.5B Abliterated MLX 4bit

Best Alternatives
Context / RAM
Downloads
Likes
Flint 40B A2.5B MLX GPTQ MXFP4256K / 21.3 GB20652
Flint 40B A2.5B Abliterated256K / 79.6 GB1806
Flint 40B A2.5B JANG 6M256K / 32.8 GB3051
...terated EXL3 4.0bpw Calibrated256K / 20.6 GB2791
....5B Abliterated FP8 Calibrated256K / 40.4 GB613
Note: green Score (e.g. "73.2") means that the model is better than dima6312/Flint-40B-A2.5B-abliterated-MLX-4bit.