LLM EXPLORER 59,358 MODELS INDEXED

Deepseek Qwen2.5 7B Redistil by jan-hq

By jan-hq · 62 downloads

Deepseek Qwen2.5 7B Redistil is an open-source language model by jan-hq. Features: 7b LLM, VRAM: 15.2GB, Context: 128K, Quantized, LLM Explorer Score: 0.17.

  Arxiv:1910.09700   Conversational   Endpoints compatible   Gguf   Quantized   Qwen2   Region:us   Safetensors   Sharded   Tensorflow

Deepseek Qwen2.5 7B Redistil Parameters and Internals

LLM NameDeepseek Qwen2.5 7B Redistil
Repository 🤗https://huggingface.co/jan-hq/Deepseek-Qwen2.5-7B-Redistil 
Model Size7b
Required VRAM15.2 GB
Updated2026-08-01
Maintainerjan-hq
Model Typeqwen2
Model Files  8.1 GB   8.1 GB   4.9 GB: 1-of-4   4.9 GB: 2-of-4   4.3 GB: 3-of-4   1.1 GB: 4-of-4
GGUF QuantizationYes
Quantization Typegguf
Model ArchitectureQwen2ForCausalLM
Context Length131072
Model Max Length131072
Transformers Version4.48.2
Tokenizer ClassLlamaTokenizer
Padding Token<|end▁of▁sentence|>
Vocabulary Size152064
Torch Data Typebfloat16

Best Alternatives to Deepseek Qwen2.5 7B Redistil

Best Alternatives
Context / RAM
Downloads
Likes
JiRackUltra 7b128K / 3 GB55370
Count Cpt V6128K / 15.2 GB3490
...lling ReSearch Gguf Q8 0 Codex128K / 8.1 GB2182
Pathumma Llm Text 1.0.0128K / 30.5 GB37712
SvelteCodeQwen1.5 7B Chat64K / 14.5 GB4600
CodeQwen1.5 7B Chat GGUF64K / 3 GB1393
Qwen2.5 7B Instruct Desyced32K / 15.2 GB4721
Uraion Agent Steer32K / 3 GB4901
Shellwhiz 7B32K / 15.2 GB1440
Qwen2 Cantonese 7B Instruct32K / 15.4 GB1214
Note: green Score (e.g. "73.2") means that the model is better than jan-hq/Deepseek-Qwen2.5-7B-Redistil.