LLM EXPLORER 57,252 MODELS INDEXED

Llama Tagger HF GPTQ 4bits by John6666

By John6666 · 8 downloads

Llama Tagger HF GPTQ 4bits is an open-source language model by John6666. Features: 6.7b LLM, VRAM: 3.9GB, Context: 2K, License: mit, Quantized, LLM Explorer Score: 0.13.

  4-bit   Gptq   Llama   Quantized   Region:us   Safetensors

Llama Tagger HF GPTQ 4bits Parameters and Internals

LLM NameLlama Tagger HF GPTQ 4bits
Repository πŸ€—https://huggingface.co/John6666/llama-tagger-HF-GPTQ-4bits 
Model Size6.7b
Required VRAM3.9 GB
Updated2026-07-21
MaintainerJohn6666
Model Typellama
Model Files  3.9 GB
GPTQ QuantizationYes
Quantization Typegptq
Model ArchitectureLlamaForCausalLM
Licensemit
Context Length2048
Model Max Length2048
Transformers Version4.42.0.dev0
Tokenizer ClassLlamaTokenizer
Vocabulary Size32000
Torch Data Typefloat16

Best Alternatives to Llama Tagger HF GPTQ 4bits

Best Alternatives
Context / RAM
Downloads
Likes
...pseek Coder 6.7B Instruct GPTQ16K / 3.9 GB51425
Magicoder S DS 6.7B GPTQ16K / 3.9 GB77
Deepseek Coder 6.7B Base GPTQ16K / 3.9 GB205
Medicine Chat GPTQ4K / 3.9 GB206
Law Chat GPTQ4K / 3.9 GB54
Finance Chat GPTQ4K / 3.9 GB43
Gorilla Openfunctions V1 GPTQ4K / 3.9 GB75
...lliott Chinese LLaMa GPTQ V1.02K / 13.5 GB520
Elliott Chinese LLaMa GPTQ2K / 13.5 GB600
Amber GPTQ2K / 3.9 GB21