What are the hardware requirements for Qwen3 4B Thinking 2507 Gemini 2.5 Flash Lite Preview Distill?

Qwen3 4B Thinking 2507 Gemini 2.5 Flash Lite Preview Distill requires approximately 8.1 GB of VRAM and supports a context window of 256K tokens. Quantized variants may run on less VRAM; see the Quantized Models section on this page.

How does Qwen3 4B Thinking 2507 Gemini 2.5 Flash Lite Preview Distill perform on standard benchmarks?

Qwen3 4B Thinking 2507 Gemini 2.5 Flash Lite Preview Distill has the following published scores: LMSYS ELO 1375. Compare against reference models on this page or on the LLM Explorer leaderboards.

Qwen3 4B Thinking 2507 Gemini 2.5 Flash Lite Preview Distill by TeichAI — VRAM 8.1GB, 256K context

Name: Qwen3 4B Thinking 2507 Gemini 2.5 Flash Lite Preview Distill
Author: TeichAI

Qwen3 4B Thinking 2507 Gemini 2.5 Flash Lite Preview Distill is an open-source language model by TeichAI. Features: 4b LLM, VRAM: 8.1GB, Context: 256K, License: apache-2.0, LLM Explorer Score: 0.34, ELO: 1375.

Base model:finetune:unsloth/qw... Base model:unsloth/qwen3-4b-th... Conversational Dataset:teichai/gemini-2.5-fla... En Endpoints compatible Qwen3 Region:us Safetensors Sharded Tensorflow Unsloth

Model Card on HF 🤗: https://huggingface.co/TeichAI/Qwen3-4B-Thinking-2507-Gemini-2.5-Flash-Lite-Preview-Distill

Qwen3 4B Thinking 2507 Gemini 2.5 Flash Lite Preview Distill Benchmarks

LMSys ELO 1375 vs 1272 (so35) 8.1%

^nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").

What is the LLM Explorer Rank (Score)

Qwen3 4B Thinking 2507 Gemini 2.5 Flash Lite Preview Distill Parameters and Internals

LLM Name	Qwen3 4B Thinking 2507 Gemini 2.5 Flash Lite Preview Distill
Repository 🤗	https://huggingface.co/TeichAI/Qwen3-4B-Thinking-2507-Gemini-2.5-Flash-Lite-Preview-Distill
Base Model(s)	Qwen3 4B Thinking 2507 unsloth/Qwen3-4B-Thinking-2507
Model Size	4b
Required VRAM	8.1 GB
Updated	2026-08-28
Maintainer	TeichAI
Model Type	qwen3
Model Files	5.0 GB: 1-of-2 3.1 GB: 2-of-2
Supported Languages	en
Model Architecture	Qwen3ForCausalLM
License	apache-2.0
Context Length	262144
Model Max Length	262144
Transformers Version	4.56.2
Tokenizer Class	Qwen2Tokenizer
Padding Token	<\|vision_pad\|>
Vocabulary Size	151936
Torch Data Type	bfloat16
Errors	replace

Rank the Qwen3 4B Thinking 2507 Gemini 2.5 Flash Lite Preview Distill capabilities

Have you tried this model? Rate its performance — this feedback helps the ML community find the right model for their needs.

Instruction Following and Task Automation
Factuality and Completeness of Knowledge
Censorship and Alignment
Data Analysis and Insight Generation
Text Generation
Text Summarization and Feature Extraction
Code Generation
Multi-Language Support and Translation

Best Alternatives to Qwen3 4B Thinking 2507 Gemini 2.5 Flash Lite Preview Distill

Best Alternatives	Context / RAM	Downloads	Likes
GRPO 4 70	256K / 8.1 GB	14	0
Qwen3 4B Instruct 2507	256K / 8.1 GB	3109972	911
FastContext 1.0 4B SFT	256K / 8.1 GB	5735	357
SRA RiskGate 4B	256K / 8 GB	2662	1
Lightning 4B	256K / 8.1 GB	13	6
Qwen3 4B Thinking 2507	256K / 8.1 GB	291023	606
Mgi Assistant V1 Qwen3 4B	256K / 8.1 GB	669	1
Qwen3 4B Instruct 2507 FP8	256K / 5.2 GB	1100744	78
FastContext 1.0 4B RL	256K / 8.1 GB	4559	61
Fable Traces	256K / 8.1 GB	128	210

Note: green Score (e.g. "73.2") means that the model is better than TeichAI/Qwen3-4B-Thinking-2507-Gemini-2.5-Flash-Lite-Preview-Distill.