Quant Gptq Hivetalk 8bits 10K V4 is an open-source language model by CNBOOMBOOM. Features: 6.7b LLM, VRAM: 7.2GB, Context: 4K, Quantized, LLM Explorer Score: 0.12.
| LLM Name | Quant Gptq Hivetalk 8bits 10K V4 |
| Repository 🤗 | https://huggingface.co/CNBOOMBOOM/quant-gptq-hivetalk-8bits-10k-v4 |
| Model Size | 6.7b |
| Required VRAM | 7.2 GB |
| Updated | 2026-09-22 |
| Maintainer | CNBOOMBOOM |
| Model Type | llama |
| Model Files | |
| GPTQ Quantization | Yes |
| Quantization Type | gptq |
| Model Architecture | LlamaForCausalLM |
| Context Length | 4096 |
| Model Max Length | 4096 |
| Transformers Version | 4.35.2 |
| Tokenizer Class | LlamaTokenizer |
| Padding Token | </s> |
| Vocabulary Size | 32000 |
| Torch Data Type | float16 |
Best Alternatives |
Context / RAM |
Downloads |
Likes |
|---|---|---|---|
| ...pseek Coder 6.7B Instruct GPTQ | 16K / 3.9 GB | 514 | 25 |
| Magicoder S DS 6.7B GPTQ | 16K / 3.9 GB | 7 | 7 |
| Deepseek Coder 6.7B Base GPTQ | 16K / 3.9 GB | 20 | 5 |
| Medicine Chat GPTQ | 4K / 3.9 GB | 20 | 6 |
| Law Chat GPTQ | 4K / 3.9 GB | 5 | 4 |
| Finance Chat GPTQ | 4K / 3.9 GB | 4 | 3 |
| Gorilla Openfunctions V1 GPTQ | 4K / 3.9 GB | 7 | 5 |
| Llama Tagger HF GPTQ 4bits | 2K / 3.9 GB | 8 | 0 |
| ...lliott Chinese LLaMa GPTQ V1.0 | 2K / 13.5 GB | 52 | 0 |
| Elliott Chinese LLaMa GPTQ | 2K / 13.5 GB | 60 | 0 |