LLM EXPLORER 65,418 MODELS INDEXED

TinyLlama 1.1B Chat V0.3 AWQ by TheBloke

By TheBloke · 143144 downloads

TinyLlama 1.1B Chat V0.3 AWQ is an open-source language model by TheBloke. Features: 1.1b LLM, VRAM: 0.8GB, Context: 2K, License: apache-2.0, Quantized, LLM Explorer Score: 0.16.

  4-bit   Awq Base model:quantized:tinyllama... Base model:tinyllama/tinyllama...   Dataset:bigcode/starcoderdata Dataset:cerebras/slimpajama-62... Dataset:openassistant/oasst to...   Deploy:azure   En   Llama   Quantized   Region:us   Safetensors

TinyLlama 1.1B Chat V0.3 AWQ Parameters and Internals

LLM NameTinyLlama 1.1B Chat V0.3 AWQ
Repository πŸ€—https://huggingface.co/TheBloke/TinyLlama-1.1B-Chat-v0.3-AWQ 
Model NameTinyLlama 1.1B Chat v0.3
Model CreatorZhang Peiyuan
Base Model(s)  PY007/TinyLlama-1.1B-Chat-v0.3   PY007/TinyLlama-1.1B-Chat-v0.3
Model Size1.1b
Required VRAM0.8 GB
Updated2026-07-13
MaintainerTheBloke
Model Typetinyllama
Model Files  0.8 GB
Supported Languagesen
AWQ QuantizationYes
Quantization Typeawq
Model ArchitectureLlamaForCausalLM
Licenseapache-2.0
Context Length2048
Model Max Length2048
Transformers Version4.34.0.dev0
Tokenizer ClassLlamaTokenizer
Vocabulary Size32003
Torch Data Typefloat16

Best Alternatives to TinyLlama 1.1B Chat V0.3 AWQ

Best Alternatives
Context / RAM
Downloads
Likes
TinyLlama 1.1B Chat V1.0 AWQ2K / 0.8 GB50
TinyLlama 1.1B Chat V1.0 AWQ2K / 0.8 GB84946
Tinyllama56k AWQ2K / 0.8 GB60
Tinyllama1b 12k AWQ2K / 0.8 GB50
Tinyllama AWQ Marlin2K / 0.8 GB41
...ntermediate Step 715K 1.5T AWQ2K / 0.8 GB62
TinyLlama 1.1B Chat V0.3 AWQ2K / 0.8 GB261
...ma 1.1B Chat V0.3 Platypus AWQ2K / 0.8 GB113
... Intermediate Step 480K 1T AWQ2K / 0.8 GB122
TinyLlama 1.1B Python V0.1 AWQ2K / 0.8 GB82
Note: green Score (e.g. "73.2") means that the model is better than TheBloke/TinyLlama-1.1B-Chat-v0.3-AWQ.