LLM EXPLORER 67,390 MODELS INDEXED

Llava Qwen 0.5B Spectraformer Attention Scienceqa by tahamajs

By tahamajs · 29 downloads
HF Repo ↗ Copy URL

Llava Qwen 0.5B Spectraformer Attention Scienceqa is an open-source language model by tahamajs. Features: 0.5b LLM, VRAM: 0.3GB, License: mit, LLM Explorer Score: 0.29.

  Attention-surgery   Attention-zoo Base model:finetune:llava-hf/l... Base model:llava-hf/llava-inte...   Conversational   Dataset:derek-thomas/scienceqa   En   Image-text-to-text   Knowledge-distillation   Linear   Llava   Model-index   Multimodal   Neuralops   Region:us   Scienceqa   Spectraformer-attention   Vision   Vision-language-model
Model Card on HF 🤗: https://huggingface.co/tahamajs/llava-qwen-0.5b-spectraformer-attention-scienceqa 

Llava Qwen 0.5B Spectraformer Attention Scienceqa Parameters and Internals

LLM NameLlava Qwen 0.5B Spectraformer Attention Scienceqa
Repository 🤗https://huggingface.co/tahamajs/llava-qwen-0.5b-spectraformer-attention-scienceqa 
Base Model(s)  llava-hf/llava-interleave-qwen-0.5b-hf   llava-hf/llava-interleave-qwen-0.5b-hf
Model Size0.5b
Required VRAM0.3 GB
Updated2026-11-13
Maintainertahamajs
Model Typellava
Model Files  0.3 GB
Supported Languagesen
Model ArchitectureLlavaForConditionalGeneration
Licensemit
Model Max Length32768
Transformers Version4.45.2
Padding Token<|endoftext|>
Torch Data Typefloat16
Errorsreplace

Best Alternatives to Llava Qwen 0.5B Spectraformer Attention Scienceqa

Best Alternatives
Context / RAM
Downloads
Likes
....5B Fused Svd Kernel Scienceqa0K / 0.2 GB441
...a Qwen 0.5B Samba M3 Scienceqa0K / 0.3 GB241
...a Qwen 0.5B Spectron Scienceqa0K / 0.1 GB221
...lava Interleave Qwen 0.5B 8bit0K / 1.3 GB231
Note: green Score (e.g. "73.2") means that the model is better than tahamajs/llava-qwen-0.5b-spectraformer-attention-scienceqa.