LLM EXPLORER 59,278 MODELS INDEXED

Omega Attention 0.5B by rekstar

By rekstar · 43 downloads
HF Repo ↗ Copy URL

Omega Attention 0.5B is an open-source language model by rekstar. Features: 0.5b LLM, License: mit, Quantized, Instruction-Based, LLM Explorer Score: 0.28.

  4bit Base model:adapter:unsloth/qwe... Base model:unsloth/qwen2.5-0.5...   Conversational   En   Endpoints compatible   Gguf   Instruct   Lora   Peft   Quantized   Region:us   Safetensors   Unsloth
Model Card on HF 🤗: https://huggingface.co/rekstar/omega-attention-0.5b 

Omega Attention 0.5B Parameters and Internals

LLM NameOmega Attention 0.5B
Repository 🤗https://huggingface.co/rekstar/omega-attention-0.5b 
Base Model(s)  unsloth/Qwen2.5-0.5B-Instruct-bnb-4bit   unsloth/Qwen2.5-0.5B-Instruct-bnb-4bit
Model Size0.5b
Required VRAM0 GB
Updated2026-08-21
Maintainerrekstar
Instruction-BasedYes
Model Files  0.0 GB
Supported Languagesen
Quantization Type4bit
Model ArchitectureAutoModel
Licensemit
Model Max Length32768
Is Biasednone
Tokenizer ClassQwen2Tokenizer
Padding Token<|vision_pad|>
PEFT TypeLORA
LoRA ModelYes
PEFT Target Modulesk_proj|up_proj|v_proj|q_proj|down_proj|gate_proj|o_proj
LoRA Alpha16
LoRA Dropout0
R Param16
Errorsreplace

Best Alternatives to Omega Attention 0.5B

Best Alternatives
Context / RAM
Downloads
Likes
...0.5B Instruct Bnb 4bit Q4KM 1E0K / 0.4 GB270
Qwen2 0.5B Instruct Sorah GGUF0K / 0.4 GB340
...0.5B Instruct Bnb 4bit Q4KM 1E0K / 0.4 GB00