LLM EXPLORER 61,561 MODELS INDEXED

DeepSeek Prover V2 7B 4bit by mlx-community

By mlx-community · 236 downloads

DeepSeek Prover V2 7B 4bit is an open-source language model by mlx-community. Features: 7b LLM, VRAM: 3.9GB, Context: 64K, Quantized, LLM Explorer Score: 0.18.

  4-bit   4bit Base model:deepseek-ai/deepsee... Base model:quantized:deepseek-...   Conversational   Llama   Mlx   Quantized   Region:us   Safetensors

DeepSeek Prover V2 7B 4bit Parameters and Internals

LLM NameDeepSeek Prover V2 7B 4bit
Repository 🤗https://huggingface.co/mlx-community/DeepSeek-Prover-V2-7B-4bit 
Base Model(s)  DeepSeek Prover V2 7B   deepseek-ai/DeepSeek-Prover-V2-7B
Model Size7b
Required VRAM3.9 GB
Updated2026-06-06
Maintainermlx-community
Model Typellama
Model Files  3.9 GB
Quantization Type4bit
Model ArchitectureLlamaForCausalLM
Context Length65536
Model Max Length65536
Transformers Version4.46.3
Tokenizer ClassLlamaTokenizerFast
Padding Token<|end▁of▁sentence|>
Vocabulary Size102400
Torch Data Typebfloat16

Best Alternatives to DeepSeek Prover V2 7B 4bit

Best Alternatives
Context / RAM
Downloads
Likes
Smaugv0.1 6.0bpw H6 EXL2195K / 26.4 GB14
Smaugv0.1 5.0bpw H6 EXL2195K / 22.3 GB33
Smaugv0.1 4.65bpw H6 EXL2195K / 20.8 GB51
Smaugv0.1 4.0bpw H6 EXL2195K / 18 GB41
Smaugv0.1 8.0bpw H8 EXL2195K / 34.9 GB41
Smaugv0.1 3.0bpw H6 EXL2195K / 13.9 GB01
Mistral 7B Openplatypus 1K32K / 29 GB18140
Mistral 7B OpenOrca 1K32K / 29 GB18113
...rnlm2 20B Llama 4.0bpw H6 EXL232K / 11 GB51
...p 0.05 Max Grad1.0 Grad Accu3232K / 14.4 GB90