LLM EXPLORER 58,297 MODELS INDEXED

Muse Glimmer 30B GPTQ INT4 by abhishekchohan

By abhishekchohan · 17 downloads

Muse Glimmer 30B GPTQ INT4 is an open-source language model by abhishekchohan. Features: 30b LLM, VRAM: 23.9GB, License: apache-2.0, Quantized, LLM Explorer Score: 0.44, ELO: 1426.

Base model:meta-models/muse-gl... Base model:quantized:meta-mode...   Compressed-tensors   Conversational   Endpoints compatible   Gptq   Image-text-to-text   Imatrix   Int4   Muse-glimmer   Muse glimmer   Quantized   Region:us   Safetensors   Sharded   Tensorflow

Muse Glimmer 30B GPTQ INT4 Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").

Muse Glimmer 30B GPTQ INT4 Parameters and Internals

LLM NameMuse Glimmer 30B GPTQ INT4
Repository πŸ€—https://huggingface.co/abhishekchohan/Muse-Glimmer-30B-GPTQ-INT4 
Base Model(s)  Muse Glimmer 30B   meta-models/Muse-Glimmer-30B
Model Size30b
Required VRAM23.9 GB
Updated2026-08-13
Maintainerabhishekchohan
Model Typemuse_glimmer
Model Files  3.7 GB: 1-of-7   4.0 GB: 2-of-7   4.0 GB: 3-of-7   4.0 GB: 4-of-7   4.0 GB: 5-of-7   1.5 GB: 6-of-7   2.7 GB: 7-of-7
GPTQ QuantizationYes
Quantization Typegptq
Model ArchitectureMuseGlimmerForConditionalGeneration
Licenseapache-2.0
Model Max Length131072
Transformers Version5.15.0
Tokenizer ClassTokenizersBackend
Padding Token<|finetune_right_pad|>

Best Alternatives to Muse Glimmer 30B GPTQ INT4

Best Alternatives
Context / RAM
Downloads
Likes
Muse Glimmer 30B 4bit0K / 19.4 GB011
...e Glimmer 30B Unsloth Bnb 4bit0K / 22.2 GB07
...immer 30B Abliterated MLX 6bit0K / 26.4 GB151
Muse Glimmer 30B0K / 59.6 GB01052
Muse Glimmer 30B AWQ INT40K / 24.1 GB9858
Muse Glimmer 30B AWQ FP80K / 34.5 GB451
Muse Glimmer 30B0K / 59.6 GB2586912
Muse Glimmer 30B FP8 Block0K / 34.4 GB194139
Muse Glimmer 30B NVFP4 W4A40K / 12.1 GB109073
Muse Glimmer 30B NVFP40K / 23.3 GB11966
Note: green Score (e.g. "73.2") means that the model is better than abhishekchohan/Muse-Glimmer-30B-GPTQ-INT4.