LLM EXPLORER 61,918 MODELS INDEXED

Qwen2 VL 72B Instruct 4bit by mlx-community

By mlx-community · 72 downloads
HF Repo ↗ Copy URL

Qwen2 VL 72B Instruct 4bit is an open-source language model by mlx-community. Features: 72b LLM, VRAM: 41.3GB, Context: 32K, License: other, Quantized, Instruction-Based, LLM Explorer Score: 0.15.

  4bit   Conversational   En   Endpoints compatible   Image-text-to-text   Instruct   Mlx   Multimodal   Quantized   Qwen2 vl   Region:us   Safetensors   Sharded   Tensorflow
Model Card on HF 🤗: https://huggingface.co/mlx-community/Qwen2-VL-72B-Instruct-4bit 

Qwen2 VL 72B Instruct 4bit Parameters and Internals

LLM NameQwen2 VL 72B Instruct 4bit
Repository 🤗https://huggingface.co/mlx-community/Qwen2-VL-72B-Instruct-4bit 
Model Size72b
Required VRAM41.3 GB
Updated2026-08-08
Maintainermlx-community
Model Typeqwen2_vl
Instruction-BasedYes
Model Files  5.3 GB: 1-of-8   5.3 GB: 2-of-8   5.3 GB: 3-of-8   5.3 GB: 4-of-8   5.3 GB: 5-of-8   5.3 GB: 6-of-8   5.3 GB: 7-of-8   4.2 GB: 8-of-8
Supported Languagesen
Quantization Type4bit
Model ArchitectureQwen2VLForConditionalGeneration
Licenseother
Context Length32768
Model Max Length32768
Transformers Version4.41.2
Tokenizer ClassQwen2Tokenizer
Padding Token<|endoftext|>
Vocabulary Size152064
Torch Data Typebfloat16
Errorsreplace

Best Alternatives to Qwen2 VL 72B Instruct 4bit

Best Alternatives
Context / RAM
Downloads
Likes
Qwen2 VL 72B Instruct Bnb 4bit32K / 41.8 GB3955
Qwen2 VL 72B Instruct 8bit32K / 77.8 GB794
Qwen2 VL 72B Instruct32K / 146.8 GB60157311
Qwen2 VL 72B Instruct AWQ32K / 43 GB8719050
Qwen2 VL 72B Instruct32K / 147.5 GB611
...wen2 VL 72B Instruct GPTQ Int432K / 43 GB53630
...wen2 VL 72B Instruct GPTQ Int832K / 78.4 GB12611
Note: green Score (e.g. "73.2") means that the model is better than mlx-community/Qwen2-VL-72B-Instruct-4bit.