LLM EXPLORER 59,420 MODELS INDEXED

Tinyllama Gguf 8B by abdymazhit

By abdymazhit · 16 downloads
HF Repo ↗ Copy URL

Tinyllama Gguf 8B is an open-source language model by abdymazhit. Features: 8b LLM, VRAM: 1.2GB, License: apache-2.0, Quantized, LLM Explorer Score: 0.13.

  4bit Base model:quantized:unsloth/t... Base model:unsloth/tinyllama-b...   En   Endpoints compatible   Gguf   Llama   Quantized   Region:us   Unsloth
Model Card on HF 🤗: https://huggingface.co/abdymazhit/tinyllama-gguf-8b 

Tinyllama Gguf 8B Parameters and Internals

Model Type 
text-generation-inference, transformers, gguf
Additional Notes 
This llama model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.
Supported Languages 
en (supported)
LLM NameTinyllama Gguf 8B
Repository 🤗https://huggingface.co/abdymazhit/tinyllama-gguf-8b 
Base Model(s)  Tinyllama Bnb 4bit   unsloth/tinyllama-bnb-4bit
Model Size8b
Required VRAM1.2 GB
Updated2026-06-20
Maintainerabdymazhit
Model Typellama
Model Files  1.2 GB
Supported Languagesen
GGUF QuantizationYes
Quantization Typegguf|4bit
Model ArchitectureAutoModel
Licenseapache-2.0

Best Alternatives to Tinyllama Gguf 8B

Best Alternatives
Context / RAM
Downloads
Likes
...lama 3.1 8B Roleplay BSNL Gguf0K / 4.9 GB97311
...ma 3.1 8B Roleplay Airtel Gguf0K / 4.9 GB6588
Llama 3.1 8B Roleplay Jio Gguf0K / 4.9 GB1235
Llama 3.1 8B Rp Tadashinu Gguf0K / 4.9 GB577
Llama 3.1 8B OneLastStory Gguf0K / 4.9 GB435
...B Instruct Bnb 4bit 24 1 100 10K / 16.1 GB590
CleverBoi Llama 3.1 8B V20K / 16.1 GB8000
...leverBoi Llama 3.1 8B Instruct0K / 0.2 GB8661
Meta Llama 3 8B Instruct GGUF0K / 2 GB96368103
...ma 3 8B Instruct 32K V0.1 GGUF0K / 2 GB8108759
Note: green Score (e.g. "73.2") means that the model is better than abdymazhit/tinyllama-gguf-8b.