LLM EXPLORER 59,420 MODELS INDEXED

QwQ 32B Preview Gptqmodel 4bit Vortex V2 by ModelCloud

By ModelCloud · 13 downloads

QwQ 32B Preview Gptqmodel 4bit Vortex V2 is an open-source language model by ModelCloud. Features: 32b LLM, VRAM: 15.8GB, Context: 32K, License: apache-2.0, Quantized, LLM Explorer Score: 0.27, ELO: 1150.

  4-bit   4bit Base model:quantized:qwen/qwq-... Base model:qwen/qwq-32b-previe...   Chat   Conversational   En   Gptq   Gptqmodel   Instruct   Int4   Modelcloud   Quantized   Qwen2   Qwq   Region:us   Safetensors   Sharded   Tensorflow   W4a16

QwQ 32B Preview Gptqmodel 4bit Vortex V2 Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").

QwQ 32B Preview Gptqmodel 4bit Vortex V2 Parameters and Internals

Best Alternatives to QwQ 32B Preview Gptqmodel 4bit Vortex V2

Best Alternatives
Context / RAM
Downloads
Likes
...Logic Mix 3 32B Mlx OptiQ 5bit128K / 22.3 GB411
...pSeek R1 Distill Qwen 32B 4bit128K / 18.5 GB779551
Hydraulic Deepseek 16bit128K / 65.8 GB520
...k R1 Distill Qwen 32B Bnb 4bit128K / 19.2 GB271729
...till Qwen 32B Abliterated 4bit128K / 18.5 GB8887
QwQ 32B Unsloth Bnb 4bit128K / 22.5 GB17947
...ogito V1 Preview Qwen 32B 4bit128K / 18.5 GB435
...T1 Flash Lightest 32B Mlx 4Bit128K / 18.5 GB2318
QwQ 32B 4bit128K / 18.5 GB13238
QwQ 32B Bnb 4bit128K / 19.2 GB1574