LLM EXPLORER 65,894 MODELS INDEXED

Flint 40B A2.5B Abliterated EXL3 4.0bpw Calibrated by cbert33

By cbert33 · 279 downloads
HF Repo ↗ Copy URL

Flint 40B A2.5B Abliterated EXL3 4.0bpw Calibrated is an open-source language model by cbert33. Features: 40b LLM, VRAM: 20.6GB, Context: 256K, License: apache-2.0, LLM Explorer Score: 0.32.

  Arxiv:2406.11717   4-bit   Abliterated Base model:dima6312/flint-40b-... Base model:quantized:dima6312/...   Calibrated-kv-cache   Conversational   Custom code   Exl3   Exllamav3   Flint   Moe   Quantized   Region:us   Safetensors   Sharded   Tensorflow   Uncensored   W4a8
Model Card on HF 🤗: https://huggingface.co/cbert33/Flint-40B-A2.5B-Abliterated-EXL3-4.0bpw-Calibrated 

Flint 40B A2.5B Abliterated EXL3 4.0bpw Calibrated Parameters and Internals

LLM NameFlint 40B A2.5B Abliterated EXL3 4.0bpw Calibrated
Repository 🤗https://huggingface.co/cbert33/Flint-40B-A2.5B-Abliterated-EXL3-4.0bpw-Calibrated 
Base Model(s)  dima6312/Flint-40B-A2.5B-abliterated   dima6312/Flint-40B-A2.5B-abliterated
Model Size40b
Required VRAM20.6 GB
Updated2026-10-27
Maintainercbert33
Model Typeflint
Model Files  8.2 GB: 1-of-3   8.4 GB: 2-of-3   4.0 GB: 3-of-3
Model ArchitectureFlintForCausalLM
Licenseapache-2.0
Context Length262144
Model Max Length262144
Transformers Version5.20.2
Tokenizer ClassTokenizersBackend
Padding Token<|end_of_text|>
Vocabulary Size150144

Best Alternatives to Flint 40B A2.5B Abliterated EXL3 4.0bpw Calibrated

Best Alternatives
Context / RAM
Downloads
Likes
Flint 40B A2.5B Abliterated256K / 79.6 GB1806
Flint 40B A2.5B JANG 6M256K / 32.8 GB3051
....5B Abliterated FP8 Calibrated256K / 40.4 GB613
...40B A2.5B Abliterated MLX 4bit256K / 3.8 GB11873
Flint 40B A2.5B MLX GPTQ MXFP4256K / 21.3 GB20652
Note: green Score (e.g. "73.2") means that the model is better than cbert33/Flint-40B-A2.5B-Abliterated-EXL3-4.0bpw-Calibrated.