LLM EXPLORER 58,297 MODELS INDEXED

Muse Glimmer 30B AWQ INT4 by cyankiwi

By cyankiwi · 985 downloads

Muse Glimmer 30B AWQ INT4 is an open-source language model by cyankiwi. Features: 30b LLM, VRAM: 24.1GB, License: apache-2.0, Quantized, LLM Explorer Score: 0.52, ELO: 1426.

  Arxiv:2504.13181   Arxiv:2602.06036   Awq Base model:meta-models/muse-gl... Base model:quantized:meta-mode...   Compressed-tensors   Conversational   Endpoints compatible   Image-text-to-text   Muse glimmer   Quantized   Region:us   Safetensors   Sharded   Tensorflow

Muse Glimmer 30B AWQ INT4 Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").

Muse Glimmer 30B AWQ INT4 Parameters and Internals

LLM NameMuse Glimmer 30B AWQ INT4
Repository πŸ€—https://huggingface.co/cyankiwi/Muse-Glimmer-30B-AWQ-INT4 
Base Model(s)  Muse Glimmer 30B   meta-models/Muse-Glimmer-30B
Model Size30b
Required VRAM24.1 GB
Updated2026-08-13
Maintainercyankiwi
Model Typemuse_glimmer
Model Files  2.7 GB: 1-of-5   5.4 GB: 2-of-5   5.3 GB: 3-of-5   5.4 GB: 4-of-5   5.3 GB: 5-of-5
AWQ QuantizationYes
Quantization Typeawq
Model ArchitectureMuseGlimmerForConditionalGeneration
Licenseapache-2.0
Model Max Length131072
Transformers Version5.16.0.dev0
Tokenizer ClassTokenizersBackend
Padding Token<|finetune_right_pad|>

Best Alternatives to Muse Glimmer 30B AWQ INT4

Best Alternatives
Context / RAM
Downloads
Likes
Muse Glimmer 30B AWQ FP80K / 34.5 GB451
Muse Glimmer 30B 4bit0K / 19.4 GB011
...e Glimmer 30B Unsloth Bnb 4bit0K / 22.2 GB07
...immer 30B Abliterated MLX 6bit0K / 26.4 GB151
Muse Glimmer 30B0K / 59.6 GB01052
Muse Glimmer 30B GPTQ INT40K / 23.9 GB172
Muse Glimmer 30B0K / 59.6 GB2586912
Muse Glimmer 30B FP8 Block0K / 34.4 GB194139
Muse Glimmer 30B NVFP4 W4A40K / 12.1 GB109073
Muse Glimmer 30B NVFP40K / 23.3 GB11966
Note: green Score (e.g. "73.2") means that the model is better than cyankiwi/Muse-Glimmer-30B-AWQ-INT4.