What are the hardware requirements for TinyLlama 3T 1.1bee?

TinyLlama 3T 1.1bee requires approximately 2.2 GB of VRAM and supports a context window of 2K tokens. Quantized variants may run on less VRAM; see the Quantized Models section on this page.

Who developed TinyLlama 3T 1.1bee and how large is it?

TinyLlama 3T 1.1bee is developed by BEE-spoke-data, a model with 1.1b parameters. The model is published as open weights on Hugging Face and indexed on LLM Explorer with full benchmark history.

How does TinyLlama 3T 1.1bee perform on standard benchmarks?

TinyLlama 3T 1.1bee has the following published scores: MMLU 25.86. Compare against reference models on this page or on the LLM Explorer leaderboards.

TinyLlama 3T 1.1bee by BEE-spoke-data — VRAM 2.2GB, 2K context

Name: TinyLlama 3T 1.1bee
Author: BEE-spoke-data

TinyLlama 3T 1.1bee is an open-source language model by BEE-spoke-data. Features: 1.1b LLM, VRAM: 2.2GB, Context: 2K, License: apache-2.0, LLM Explorer Score: 0.15, Arc: 33.8, HellaSwag: 60.3, MMLU: 25.9, GSM8K: 0.5.

Base model:finetune:tinyllama/... Base model:tinyllama/tinyllama... Bees Bzz Dataset:bee-spoke-data/bees-in... En Endpoints compatible Honey Llama Model-index Oprah winfrey Region:us Safetensors

Model Card on HF 🤗: https://huggingface.co/BEE-spoke-data/TinyLlama-3T-1.1bee

TinyLlama 3T 1.1bee Parameters and Internals

Model Type

text-generation

Additional Notes

This model is a fine-tuned version focusing on beekeeping using a specialized dataset, with improvements starting from a finished 3T TinyLlama.

Training Details

Data Sources:

BEE-spoke-data/bees-internal

Model Architecture:

Starts from finished 3T TinyLlama. Vastly improved and expanded SoTA beekeeping dataset

LLM Name	TinyLlama 3T 1.1bee
Repository 🤗	https://huggingface.co/BEE-spoke-data/TinyLlama-3T-1.1bee
Base Model(s)	TinyLlama/TinyLlama-1.1B-intermediate-step-1431k-3T TinyLlama/TinyLlama-1.1B-intermediate-step-1431k-3T
Model Size	1.1b
Required VRAM	2.2 GB
Updated	2026-08-13
Maintainer	BEE-spoke-data
Model Type	llama
Model Files	2.2 GB 0.0 GB
Supported Languages	en
Model Architecture	LlamaForCausalLM
License	apache-2.0
Context Length	2048
Model Max Length	2048
Transformers Version	4.36.2
Tokenizer Class	LlamaTokenizer
Padding Token	</s>
Vocabulary Size	32000
Torch Data Type	bfloat16

Rank the TinyLlama 3T 1.1bee capabilities

Have you tried this model? Rate its performance — this feedback helps the ML community find the right model for their needs.

Instruction Following and Task Automation
Factuality and Completeness of Knowledge
Censorship and Alignment
Data Analysis and Insight Generation
Text Generation
Text Summarization and Feature Extraction
Code Generation
Multi-Language Support and Translation

Best Alternatives to TinyLlama 3T 1.1bee

Best Alternatives	Context / RAM	Downloads	Likes
TinyKiller NSFW DPO 1.1B	32K / 2.2 GB	12	0
Coven Tiny 1.1b 32k Orpo Alpha	32K / 2.2 GB	9	2
Test Mix 01	32K / 2.2 GB	5	0
Palmer Merge Test 5	32K / 2.2 GB	5	0
TinyLlama 1.1B 32K Instruct	32K / 2.2 GB	3123	13
...llama 1.1B 16K Instructions V4	32K / 2.2 GB	8	0
TinyJ.O.S.I.E. 1.1B 32K Base	32K / 2.2 GB	30	1
Palmer 002 32K	32K / 2.2 GB	9	0
TinyJ.O.S.I.E. 1.1B 32K Base	32K / 2.2 GB	5	1
...lama 1.1B 16K Instructions Rag	32K / 2.2 GB	25	0

Note: green Score (e.g. "73.2") means that the model is better than BEE-spoke-data/TinyLlama-3T-1.1bee.