LLM EXPLORER 65,418 MODELS INDEXED

Tiny Llama Qlora by AayushShah

By AayushShah · 0 downloads

Tiny Llama Qlora is an open-source language model by AayushShah. Features: 1.1b LLM, License: apache-2.0, LLM Explorer Score: 0.09.

  Adapter Base model:finetune:tinyllama/... Base model:tinyllama/tinyllama...   Finetuned   Generated from trainer   Lora   Region:us

Tiny Llama Qlora Parameters and Internals

LLM NameTiny Llama Qlora
Repository πŸ€—https://huggingface.co/AayushShah/tiny_llama-qlora 
Base Model(s)  PY007/TinyLlama-1.1B-Chat-v0.3   PY007/TinyLlama-1.1B-Chat-v0.3
Model Size1.1b
Required VRAM0 GB
Updated2026-10-21
MaintainerAayushShah
Model Files  0.0 GB   0.0 GB
Model ArchitectureAdapter
Licenseapache-2.0
Is Biasednone
Tokenizer ClassLlamaTokenizer
Padding Token</s>
PEFT TypeLORA
LoRA ModelYes
PEFT Target Modulesq_proj|v_proj
LoRA Alpha16
LoRA Dropout0.05
R Param32

Quantized Models of the Tiny Llama Qlora

Model
Likes
Downloads
VRAM
TinyLlama 1.1B Chat V0.3 GPTQ08270 GB
TinyLlama 1.1B Chat V0.3 GGUF0520 GB
TinyLlama 1.1B Chat V0.3 GGUF1610 GB
TinyLlama 1.1B Chat V0.3 AWQ1260 GB

Best Alternatives to Tiny Llama Qlora

Best Alternatives
Context / RAM
Downloads
Likes
Dulcebot Tinyllama Lora0K / 0 GB241
Testing0K / 0 GB50
Openhermes Tinyllama Sft Qlora0K / 0 GB60
Zephyr Tinyllama Sft Qlora0K / 0 GB50
...hyr Tiny Sft Qlora Quantized 20K / 0 GB440
Zephyr Tiny DPO Qlora0K / 0.1 GB320
DPO Mcqa V1.020K / 0.4 GB50
DPO Mcqa QuantizedBitsAndBytes0K / 0.8 GB50
MCQDPO10K / 0 GB110
Mcqa0K / 0 GB50
Note: green Score (e.g. "73.2") means that the model is better than AayushShah/tiny_llama-qlora.