LLM EXPLORER 60,897 MODELS INDEXED

Llama3 8B Chinese Chat AWQ by wsagi

By wsagi · 8 downloads
HF Repo ↗ Copy URL

Llama3 8B Chinese Chat AWQ is an open-source language model by wsagi. Features: 8b LLM, VRAM: 5.8GB, Context: 8K, Quantized, LLM Explorer Score: 0.12.

  4-bit   Awq Base model:quantized:shenzhi-w... Base model:shenzhi-wang/llama3...   Conversational   Endpoints compatible   Llama   Quantized   Region:us   Safetensors   Sharded   Tensorflow
Model Card on HF 🤗: https://huggingface.co/wsagi/Llama3-8B-Chinese-Chat-AWQ 

Llama3 8B Chinese Chat AWQ Parameters and Internals

Model Type 
text-generation
LLM NameLlama3 8B Chinese Chat AWQ
Repository 🤗https://huggingface.co/wsagi/Llama3-8B-Chinese-Chat-AWQ 
Base Model(s)  Llama3 8B Chinese Chat   shenzhi-wang/Llama3-8B-Chinese-Chat
Model Size8b
Required VRAM5.8 GB
Updated2026-07-24
Maintainerwsagi
Model Typellama
Model Files  4.7 GB: 1-of-2   1.1 GB: 2-of-2
AWQ QuantizationYes
Quantization Typeawq
Model ArchitectureLlamaForCausalLM
Context Length8192
Model Max Length8192
Transformers Version4.38.2
Tokenizer ClassPreTrainedTokenizerFast
Padding Token<|eot_id|>
Vocabulary Size128256
Torch Data Typefloat16

Best Alternatives to Llama3 8B Chinese Chat AWQ

Best Alternatives
Context / RAM
Downloads
Likes
...8B Instruct Gradient 1048K AWQ1024K / 5.8 GB80
...radient 1048K AWQ 4bit Smashed1024K / 5.8 GB71
...Instruct 262K AWQ 4bit Smashed256K / 5.8 GB54
...ta Llama 3 8B Instruct 64K AWQ64K / 5.8 GB60
... Instruct 8B 32K V0.1 4bit AWQ64K / 5.8 GB90
Llama 3 8B Instruct AWQ8K / 5.8 GB2545831
Meta Llama 3 8B Instruct AWQ8K / 5.8 GB60
Meta Llama 3 8B Instruct AWQ8K / 5.8 GB5630
Meta Llama 3 8B Instruct AWQ8K / 5.8 GB70
Meta Llama 3 8B Instruct AWQ8K / 5.8 GB4015
Note: green Score (e.g. "73.2") means that the model is better than wsagi/Llama3-8B-Chinese-Chat-AWQ.