LLM EXPLORER 65,418 MODELS INDEXED

TinyLlama 1.1B Intermediate Step 480K 1T AWQ by TheBloke

By TheBloke · 12 downloads

TinyLlama 1.1B Intermediate Step 480K 1T AWQ is an open-source language model by TheBloke. Features: 1.1b LLM, VRAM: 0.8GB, Context: 2K, License: apache-2.0, Quantized, LLM Explorer Score: 0.09.

  4-bit   Awq Base model:quantized:tinyllama... Base model:tinyllama/tinyllama...   Dataset:bigcode/starcoderdata Dataset:cerebras/slimpajama-62...   En   Llama   Quantized   Region:us   Safetensors

TinyLlama 1.1B Intermediate Step 480K 1T AWQ Parameters and Internals

LLM NameTinyLlama 1.1B Intermediate Step 480K 1T AWQ
Repository πŸ€—https://huggingface.co/TheBloke/TinyLlama-1.1B-intermediate-step-480k-1T-AWQ 
Model NameTinyLlama 1.1B Intermediate Step 480K 1T
Model CreatorZhang Peiyuan
Base Model(s)  PY007/TinyLlama-1.1B-intermediate-step-480k-1T   PY007/TinyLlama-1.1B-intermediate-step-480k-1T
Model Size1.1b
Required VRAM0.8 GB
Updated2026-08-05
MaintainerTheBloke
Model Typetinyllama
Model Files  0.8 GB
Supported Languagesen
AWQ QuantizationYes
Quantization Typeawq
Model ArchitectureLlamaForCausalLM
Licenseapache-2.0
Context Length2048
Model Max Length2048
Transformers Version4.34.0
Tokenizer ClassLlamaTokenizer
Beginning of Sentence Token<s>
End of Sentence Token</s>
Unk Token<unk>
Vocabulary Size32000
Torch Data Typefloat16

Best Alternatives to TinyLlama 1.1B Intermediate Step 480K 1T AWQ

Best Alternatives
Context / RAM
Downloads
Likes
TinyLlama 1.1B Chat V1.0 AWQ2K / 0.8 GB50
TinyLlama 1.1B Chat V0.3 AWQ2K / 0.8 GB1431445
TinyLlama 1.1B Chat V1.0 AWQ2K / 0.8 GB84946
Tinyllama56k AWQ2K / 0.8 GB60
Tinyllama1b 12k AWQ2K / 0.8 GB50
Tinyllama AWQ Marlin2K / 0.8 GB41
...ntermediate Step 715K 1.5T AWQ2K / 0.8 GB62
TinyLlama 1.1B Chat V0.3 AWQ2K / 0.8 GB261
...ma 1.1B Chat V0.3 Platypus AWQ2K / 0.8 GB113
TinyLlama 1.1B Python V0.1 AWQ2K / 0.8 GB82
Note: green Score (e.g. "73.2") means that the model is better than TheBloke/TinyLlama-1.1B-intermediate-step-480k-1T-AWQ.