LLM EXPLORER 57,252 MODELS INDEXED

Elliott Chinese LLaMa GPTQ by elliotthwang

By elliotthwang · 60 downloads

Elliott Chinese LLaMa GPTQ is an open-source language model by elliotthwang. Features: 6.7b LLM, VRAM: 13.5GB, Context: 2K, Quantized, LLM Explorer Score: 0.11, Arc: 51, HellaSwag: 75.2, MMLU: 49.6, GSM8K: 17.2.

  Endpoints compatible   Gptq   Llama   Quantized   Region:us   Safetensors   Sharded   Tensorflow

Elliott Chinese LLaMa GPTQ Parameters and Internals

LLM NameElliott Chinese LLaMa GPTQ
Repository πŸ€—https://huggingface.co/elliotthwang/Elliott-Chinese-LLaMa-GPTQ 
Model Size6.7b
Required VRAM13.5 GB
Updated2026-07-27
Maintainerelliotthwang
Model Typellama
Model Files  10.0 GB: 1-of-2   3.5 GB: 2-of-2
GPTQ QuantizationYes
Quantization Typegptq
Model ArchitectureLlamaForCausalLM
Context Length2048
Model Max Length2048
Transformers Version4.31.0
Tokenizer ClassLlamaTokenizer
Beginning of Sentence Token<s>
End of Sentence Token</s>
Unk Token<unk>
Vocabulary Size32000
Torch Data Typefloat16

Best Alternatives to Elliott Chinese LLaMa GPTQ

Best Alternatives
Context / RAM
Downloads
Likes
...pseek Coder 6.7B Instruct GPTQ16K / 3.9 GB51425
Magicoder S DS 6.7B GPTQ16K / 3.9 GB77
Deepseek Coder 6.7B Base GPTQ16K / 3.9 GB205
Medicine Chat GPTQ4K / 3.9 GB206
Law Chat GPTQ4K / 3.9 GB54
Finance Chat GPTQ4K / 3.9 GB43
Gorilla Openfunctions V1 GPTQ4K / 3.9 GB75
Llama Tagger HF GPTQ 4bits2K / 3.9 GB80
...lliott Chinese LLaMa GPTQ V1.02K / 13.5 GB520
Amber GPTQ2K / 3.9 GB21
Note: green Score (e.g. "73.2") means that the model is better than elliotthwang/Elliott-Chinese-LLaMa-GPTQ.