Model Type |
| ||||||||||||||||||
Use Cases |
| ||||||||||||||||||
Additional Notes |
| ||||||||||||||||||
Supported Languages |
| ||||||||||||||||||
Training Details |
| ||||||||||||||||||
Input Output |
|
LLM Name | Liberated Qwen1.5 14B 4bit |
Repository ๐ค | https://huggingface.co/titan087/Liberated-Qwen1.5-14B-4bit |
Base Model(s) | |
Model Size | 14b |
Required VRAM | 9.7 GB |
Updated | 2025-08-19 |
Maintainer | titan087 |
Model Type | qwen2 |
Model Files | |
Supported Languages | en |
GPTQ Quantization | Yes |
Quantization Type | gptq|4bit |
Model Architecture | Qwen2ForCausalLM |
License | other |
Context Length | 32768 |
Model Max Length | 32768 |
Transformers Version | 4.39.0.dev0 |
Tokenizer Class | Qwen2Tokenizer |
Padding Token | <|endoftext|> |
Vocabulary Size | 152064 |
Torch Data Type | float16 |
Errors | replace |
Best Alternatives |
Context / RAM |
Downloads |
Likes |
---|---|---|---|
Qwen2.5 14B Instruct GPTQ Int4 | 32K / 10 GB | 10697 | 21 |
...5 Coder 14B Instruct GPTQ Int4 | 32K / 10 GB | 2446 | 5 |
Qwen2.5 14B Instruct GPTQ Int8 | 32K / 16.8 GB | 3798 | 21 |
...5 Coder 14B Instruct GPTQ Int8 | 32K / 16.8 GB | 1076 | 5 |
VinaLlama2 14B GPTQ Int4 | 32K / 9.7 GB | 4 | 2 |
Qwen1.5 14B Chat GPTQ Int4 | 32K / 9.9 GB | 1218 | 21 |
Qwen1.5 14B Chat GPTQ Int8 | 32K / 16.5 GB | 13 | 11 |
Qwen2.5 14B Instruct 1M 8bit | 986K / 15.7 GB | 33 | 7 |
...B Instruct 1M Unsloth Bnb 4bit | 986K / 14.3 GB | 14 | 4 |
Qwen2.5 14B Instruct 1M 4bit | 986K / 8.3 GB | 18 | 2 |
๐ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐