LLM EXPLORER 60,645 MODELS INDEXED

Distill Qw Test by aevalone

By aevalone · 5 downloads
HF Repo ↗ Copy URL

Distill Qw Test is an open-source language model by aevalone. Features: 7b LLM, VRAM: 15.2GB, Context: 32K, License: apache-2.0, Quantized, Instruction-Based, LLM Explorer Score: 0.26.

  4bit   Autotrain compatible   Conversational Dataset:magpie-align/magpie-re...   En   Endpoints compatible   Instruct   Quantized   Qwen2   Region:us   Safetensors   Sft   Sharded   Tensorflow   Trl   Unsloth
Model Card on HF 🤗: https://huggingface.co/aevalone/distill_qw_test 

Distill Qw Test Parameters and Internals

LLM NameDistill Qw Test
Repository 🤗https://huggingface.co/aevalone/distill_qw_test 
Base Model(s)  unsloth/qwen2.5-7b-instruct-bnb-4bit   unsloth/qwen2.5-7b-instruct-bnb-4bit
Model Size7b
Required VRAM15.2 GB
Updated2025-05-04
Maintaineraevalone
Model Typeqwen2
Instruction-BasedYes
Model Files  4.9 GB: 1-of-4   4.9 GB: 2-of-4   4.3 GB: 3-of-4   1.1 GB: 4-of-4
Supported Languagesen
Quantization Type4bit
Model ArchitectureQwen2ForCausalLM
Licenseapache-2.0
Context Length32768
Model Max Length32768
Transformers Version4.48.3
Tokenizer ClassQwen2Tokenizer
Padding Token<|vision_pad|>
Vocabulary Size152064
Torch Data Typebfloat16
Errorsreplace

Best Alternatives to Distill Qw Test

Best Alternatives
Context / RAM
Downloads
Likes
Qwen2.5 7B Instruct 1M 4bit986K / 4.3 GB44411
...wen2.5 7B Instruct 1M Bnb 4bit986K / 5.5 GB2671
Qwen2.5 7B Instruct 1M 8bit986K / 8.1 GB634
Qwen2.5 7B Instruct 1M 6bit986K / 6.2 GB522
...B Instruct 1M Unsloth Bnb 4bit986K / 7.5 GB373
Legal Qwen2.5 7B Sft128K / 15.2 GB1040
Alisia 7B Instruct V1128K / 15.4 GB1142
...5 7B Instruct SFT Meme LoRA V7128K / 15.2 GB60
Gte Qwen2 7B Instruct 4bit DWQ128K / 4.3 GB883
...en2.5 7B Indonesian Alpaca Sft32K / 15.2 GB3401
Note: green Score (e.g. "73.2") means that the model is better than aevalone/distill_qw_test.