LLM EXPLORER 59,420 MODELS INDEXED

Athena TinyLlama V0.1 by NotAiLOL

By NotAiLOL · 14 downloads
HF Repo ↗ Copy URL

Athena TinyLlama V0.1 is an open-source language model by NotAiLOL. Features: 1.1b LLM, VRAM: 2.2GB, Context: 16K, License: apache-2.0, Quantized, LLM Explorer Score: 0.12.

  4bit   Autotrain compatible Base model:finetune:unsloth/ti... Base model:unsloth/tinyllama-b...   Dataset:notailol/athena-v0.1   En   Endpoints compatible   Llama   Pytorch   Quantized   Region:us   Safetensors   Sft   Trl   Unsloth
Model Card on HF 🤗: https://huggingface.co/NotAiLOL/Athena-TinyLlama-v0.1 

Athena TinyLlama V0.1 Parameters and Internals

LLM NameAthena TinyLlama V0.1
Repository 🤗https://huggingface.co/NotAiLOL/Athena-TinyLlama-v0.1 
Base Model(s)  Tinyllama Bnb 4bit   unsloth/tinyllama-bnb-4bit
Model Size1.1b
Required VRAM2.2 GB
Updated2024-08-10
MaintainerNotAiLOL
Model Typellama
Model Files  2.2 GB   2.2 GB
Supported Languagesen
Quantization Type4bit
Model ArchitectureLlamaForCausalLM
Licenseapache-2.0
Context Length16384
Model Max Length16384
Transformers Version4.39.3
Tokenizer ClassLlamaTokenizer
Padding Token<unk>
Vocabulary Size32000
Torch Data Typefloat16

Best Alternatives to Athena TinyLlama V0.1

Best Alternatives
Context / RAM
Downloads
Likes
...E TinyLlama 1.1B 32K Base 4bit32K / 0.6 GB171
...E TinyLlama 1.1B 32K Base 8bit32K / 1.2 GB171
...1B 32K Instruct 8.0bpw H8 EXL232K / 1.2 GB61
...1B 32K Instruct 3.0bpw H6 EXL232K / 0.5 GB60
...lama PY CODER 4bit Lora 4k V124K / 2.2 GB80
Tinyllama Coder Py V144K / 2.2 GB50
...icipal Prediction Merged Model4K / 2.2 GB60
TiamaPY V274K / 2.2 GB70
TiamaPY 1.1B V244K / 2.2 GB70
Merged 4bit Tiny Llama Gc24K / 0.8 GB50
Note: green Score (e.g. "73.2") means that the model is better than NotAiLOL/Athena-TinyLlama-v0.1.