LLM EXPLORER 57,252 MODELS INDEXED

Elliott Chinese LLaMa GPTQ V1.0 by elliotthwang

By elliotthwang · 52 downloads

Elliott Chinese LLaMa GPTQ V1.0 is an open-source language model by elliotthwang. Features: 6.7b LLM, VRAM: 13.5GB, Context: 2K, Quantized, LLM Explorer Score: 0.11, Arc: 50.7, HellaSwag: 75.4, MMLU: 49.3, GSM8K: 17.4.

  Endpoints compatible   Gptq   Llama   Quantized   Region:us   Safetensors   Sharded   Tensorflow

Elliott Chinese LLaMa GPTQ V1.0 Parameters and Internals

LLM NameElliott Chinese LLaMa GPTQ V1.0
Repository πŸ€—https://huggingface.co/elliotthwang/Elliott-Chinese-LLaMa-GPTQ-V1.0 
Model Size6.7b
Required VRAM13.5 GB
Updated2026-08-04
Maintainerelliotthwang
Model Typellama
Model Files  10.0 GB: 1-of-2   3.5 GB: 2-of-2
GPTQ QuantizationYes
Quantization Typegptq
Model ArchitectureLlamaForCausalLM
Context Length2048
Model Max Length2048
Transformers Version4.31.0
Tokenizer ClassLlamaTokenizer
Beginning of Sentence Token<s>
End of Sentence Token</s>
Unk Token<unk>
Vocabulary Size32000
Torch Data Typefloat16

Best Alternatives to Elliott Chinese LLaMa GPTQ V1.0

Best Alternatives
Context / RAM
Downloads
Likes
...pseek Coder 6.7B Instruct GPTQ16K / 3.9 GB51425
Magicoder S DS 6.7B GPTQ16K / 3.9 GB77
Deepseek Coder 6.7B Base GPTQ16K / 3.9 GB205
Medicine Chat GPTQ4K / 3.9 GB206
Law Chat GPTQ4K / 3.9 GB54
Finance Chat GPTQ4K / 3.9 GB43
Gorilla Openfunctions V1 GPTQ4K / 3.9 GB75
Llama Tagger HF GPTQ 4bits2K / 3.9 GB80
Elliott Chinese LLaMa GPTQ2K / 13.5 GB600
Amber GPTQ2K / 3.9 GB21
Note: green Score (e.g. "73.2") means that the model is better than elliotthwang/Elliott-Chinese-LLaMa-GPTQ-V1.0.