LLM EXPLORER 59,358 MODELS INDEXED

DeepSeek R1 Distill Qwen 14B Abliterated V2 Q4 Mlx by mlx-community

By mlx-community · 201 downloads

DeepSeek R1 Distill Qwen 14B Abliterated V2 Q4 Mlx is an open-source language model by mlx-community. Features: 14b LLM, VRAM: 8.3GB, Context: 128K, Quantized, LLM Explorer Score: 0.17.

  4-bit   Abliterated Base model:huihui-ai/deepseek-... Base model:quantized:huihui-ai...   Conversational   Endpoints compatible   Mlx   Mlx-my-repo   Q4   Quantized   Qwen2   Region:us   Safetensors   Sharded   Tensorflow   Uncensored

DeepSeek R1 Distill Qwen 14B Abliterated V2 Q4 Mlx Parameters and Internals

LLM NameDeepSeek R1 Distill Qwen 14B Abliterated V2 Q4 Mlx
Repository 🤗https://huggingface.co/mlx-community/DeepSeek-R1-Distill-Qwen-14B-abliterated-v2-Q4-mlx 
Base Model(s)  ...istill Qwen 14B Abliterated V2   huihui-ai/DeepSeek-R1-Distill-Qwen-14B-abliterated-v2
Model Size14b
Required VRAM8.3 GB
Updated2026-06-06
Maintainermlx-community
Model Typeqwen2
Model Files  5.3 GB: 1-of-2   3.0 GB: 2-of-2
Quantization Typeq4
Model ArchitectureQwen2ForCausalLM
Context Length131072
Model Max Length131072
Transformers Version4.43.1
Tokenizer ClassLlamaTokenizer
Padding Token<|end▁of▁sentence|>
Vocabulary Size152064
Torch Data Typebfloat16

Best Alternatives to DeepSeek R1 Distill Qwen 14B Abliterated V2 Q4 Mlx

Best Alternatives
Context / RAM
Downloads
Likes
Qwen2.5 14B Instruct 1M 8bit986K / 15.7 GB43012
Qwen2.5 14B Instruct 1M 4bit986K / 8.3 GB3792
...en2.5 14B Instruct 1M Bnb 4bit986K / 9.9 GB952
...B Instruct 1M Unsloth Bnb 4bit986K / 14.3 GB144
Faqih R1 14B Islamic AI128K / 29.6 GB41440
QwQ 14B Math V0.2128K / 29.7 GB14715
Qwen Carpmuscle V0.3128K / 29.7 GB70
Qwen2.5 14B Bnb 4bit128K / 9.9 GB1082925
...till Qwen 14B Unsloth Bnb 4bit128K / 14.2 GB1141130
Shed Coder 0.2128K / 9.9 GB160
Note: green Score (e.g. "73.2") means that the model is better than mlx-community/DeepSeek-R1-Distill-Qwen-14B-abliterated-v2-Q4-mlx.