LLM EXPLORER 59,420 MODELS INDEXED

TinyLlama 1.1B 32K GGUF by andrijdavid

By andrijdavid · 211 downloads

TinyLlama 1.1B 32K GGUF is an open-source language model by andrijdavid. Features: 1.1b LLM, VRAM: 0.5GB, Context: 32K, License: apache-2.0, Quantized, LLM Explorer Score: 0.11.

Dataset:togethercomputer/redpa...   En   Endpoints compatible   Gguf   Llama   Llama 2   Q2   Quantized   Region:us

TinyLlama 1.1B 32K GGUF Parameters and Internals

Model Type 
text generation
Additional Notes 
Quantization in GGUF format allows various file sizes useful for different computational capacities.
Training Details 
Data Sources:
togethercomputer/RedPajama-Data-1T-Sample
Methodology:
32k context finetune with increased rope theta
Context Length:
32768
LLM NameTinyLlama 1.1B 32K GGUF
Repository πŸ€—https://huggingface.co/andrijdavid/TinyLlama-1.1B-32k-GGUF 
Base Model(s)  Doctor-Shotgun/TinyLlama-1.1B-32k   Doctor-Shotgun/TinyLlama-1.1B-32k
Model Size1.1b
Required VRAM0.5 GB
Updated2026-07-15
Maintainerandrijdavid
Model Typellama
Model Files  0.5 GB   0.6 GB   0.6 GB   0.6 GB   0.5 GB   0.6 GB   0.7 GB   0.7 GB   0.7 GB   0.6 GB   0.8 GB   0.8 GB   0.8 GB   0.8 GB   0.8 GB   0.9 GB   1.2 GB   2.2 GB
Supported Languagesen
GGUF QuantizationYes
Quantization Typegguf|q2|q4_k|q5_k
Model ArchitectureLlamaForCausalLM
Licenseapache-2.0
Context Length32768
Model Max Length32768
Transformers Version4.36.2
Tokenizer ClassLlamaTokenizer
Padding Token</s>
Vocabulary Size32000
Torch Data Typebfloat16

Best Alternatives to TinyLlama 1.1B 32K GGUF

Best Alternatives
Context / RAM
Downloads
Likes
TinyllamaMix 1.1B32K / 2.2 GB1022
Palmer 004 240632K / 2.2 GB5740
Palmer 00432K / 2.2 GB71
Tinyllama Coder Py V134K / 0.7 GB2030
Tinyllama Coder Py V124K / 0.7 GB1840
Tinyllama Coder Py 4bit V34K / 1.2 GB320
Tinyllama Coder Py 4bit V44K / 1.2 GB170
...llama PY CODER 4bit Lora 4k V54K / 0.7 GB240
Tinyllama Coder Py 4bit V104K / 0.7 GB650
TiamaPY V344K / 0.7 GB1200
Note: green Score (e.g. "73.2") means that the model is better than andrijdavid/TinyLlama-1.1B-32k-GGUF.