LLM EXPLORER 63,069 MODELS INDEXED

Gaze Attention Qwen3 4B 384 by junha1125

By junha1125 · 25 downloads

Gaze Attention Qwen3 4B 384 is an open-source language model by junha1125. Features: 4b LLM, VRAM: 9.7GB, Context: 256K, License: apache-2.0, Instruction-Based, LLM Explorer Score: 0.28.

  Arxiv:2605.13080 Base model:finetune:qwen/qwen3... Base model:qwen/qwen3-4b-instr...   Cambrian   Cambrian qwen3   Conversational Dataset:nyu-visionx/cambrian-1... Dataset:nyu-visionx/cambrian-a...   En   Gaze-attention   Image-text-to-text   Instruct   Multimodal   Region:us   Safetensors   Sharded   Tensorflow   Vision   Vision-language

Gaze Attention Qwen3 4B 384 Parameters and Internals

LLM NameGaze Attention Qwen3 4B 384
Repository πŸ€—https://huggingface.co/junha1125/gaze-attention-qwen3-4b-384 
Base Model(s)  Qwen3 4B Instruct 2507   google/siglip2-so400m-patch16-384   Qwen/Qwen3-4B-Instruct-2507   google/siglip2-so400m-patch16-384
Model Size4b
Required VRAM9.7 GB
Updated2026-10-05
Maintainerjunha1125
Model Typecambrian_qwen3
Instruction-BasedYes
Model Files  5.0 GB: 1-of-2   4.7 GB: 2-of-2
Supported Languagesen
Model ArchitectureCambrianQwen3ForCausalLM
Licenseapache-2.0
Context Length262144
Model Max Length262144
Transformers Version4.51.0
Tokenizer ClassQwen2Tokenizer
Padding Token<|endoftext|>
Vocabulary Size151673
Torch Data Typefloat16
Errorsreplace

Best Alternatives to Gaze Attention Qwen3 4B 384

Best Alternatives
Context / RAM
Downloads
Likes
Gaze Attention Qwen3 4B 512256K / 9.7 GB211
...tention Qwen3 4B 384 Onevision256K / 9.7 GB201