What are the hardware requirements for TinyLlama Cinder Agent Rag?

TinyLlama Cinder Agent Rag requires approximately 4.4 GB of VRAM and supports a context window of 2K tokens. Quantized variants may run on less VRAM; see the Quantized Models section on this page.

Who developed TinyLlama Cinder Agent Rag and how large is it?

TinyLlama Cinder Agent Rag is developed by Josephgflowers, a model with 1.1b parameters. The model is published as open weights on Hugging Face and indexed on LLM Explorer with full benchmark history.

How does TinyLlama Cinder Agent Rag perform on standard benchmarks?

TinyLlama Cinder Agent Rag has the following published scores: MMLU 25.2. Compare against reference models on this page or on the LLM Explorer leaderboards.

TinyLlama Cinder Agent Rag by Josephgflowers — VRAM 4.4GB, 2K context

Name: TinyLlama Cinder Agent Rag
Author: Josephgflowers

TinyLlama Cinder Agent Rag is an open-source language model by Josephgflowers. Features: 1.1b LLM, VRAM: 4.4GB, Context: 2K, License: mit, LLM Explorer Score: 0.16, Arc: 34.6, HellaSwag: 53.8, MMLU: 25.2, GSM8K: 14.9.

Base model:finetune:josephgflo... Base model:josephgflowers/tiny... Conversational Endpoints compatible Generated from trainer Llama Region:us Safetensors

Model Card on HF 🤗: https://huggingface.co/Josephgflowers/TinyLlama-Cinder-Agent-Rag

TinyLlama Cinder Agent Rag Parameters and Internals

Model Type

RAG, Summary, Function Calling, Tool Usage

Use Cases

Areas:

RAG, Chat, Summary, Tool Usage

Additional Notes

This is first pass training. Further training and model update coming.

Training Details

Data Sources:

https://huggingface.co/datasets/Josephgflowers/agent_1

LLM Name	TinyLlama Cinder Agent Rag
Repository 🤗	https://huggingface.co/Josephgflowers/TinyLlama-Cinder-Agent-Rag
Base Model(s)	Josephgflowers/TinyLlama-3T-Cinder-v1.2 Josephgflowers/TinyLlama-3T-Cinder-v1.2
Model Size	1.1b
Required VRAM	4.4 GB
Updated	2026-08-01
Maintainer	Josephgflowers
Model Type	llama
Model Files	4.4 GB 0.0 GB
Model Architecture	LlamaForCausalLM
License	mit
Context Length	2048
Model Max Length	2048
Transformers Version	4.41.0.dev0
Tokenizer Class	LlamaTokenizer
Padding Token	</s>
Vocabulary Size	32000
Torch Data Type	float32

Rank the TinyLlama Cinder Agent Rag capabilities

Have you tried this model? Rate its performance — this feedback helps the ML community find the right model for their needs.

Instruction Following and Task Automation
Factuality and Completeness of Knowledge
Censorship and Alignment
Data Analysis and Insight Generation
Text Generation
Text Summarization and Feature Extraction
Code Generation
Multi-Language Support and Translation

Best Alternatives to TinyLlama Cinder Agent Rag

Best Alternatives	Context / RAM	Downloads	Likes
AgenticASR Refiner	128K / 4.3 GB	58	2
TinyKiller NSFW DPO 1.1B	32K / 2.2 GB	12	0
Coven Tiny 1.1b 32k Orpo Alpha	32K / 2.2 GB	9	2
Test Mix 01	32K / 2.2 GB	5	0
Palmer Merge Test 5	32K / 2.2 GB	5	0
...llama 1.1B 16K Instructions V4	32K / 2.2 GB	8	0
TinyLlama 1.1B 32K Instruct	32K / 2.2 GB	433	13
TinyJ.O.S.I.E. 1.1B 32K Base	32K / 2.2 GB	30	1
Palmer 002 32K	32K / 2.2 GB	9	0
TinyJ.O.S.I.E. 1.1B 32K Base	32K / 2.2 GB	5	1

Note: green Score (e.g. "73.2") means that the model is better than Josephgflowers/TinyLlama-Cinder-Agent-Rag.