LLM EXPLORER 58,608 MODELS INDEXED

SERA 8B GA 4bit by mlx-community

By mlx-community · 9 downloads

SERA 8B GA 4bit is an open-source language model by mlx-community. Features: 8b LLM, VRAM: 4.6GB, Context: 40K, Quantized, LLM Explorer Score: 0.22.

  4-bit   4bit   Base model:allenai/sera-8b-ga Base model:quantized:allenai/s...   Conversational   Mlx   Quantized   Qwen3   Region:us   Safetensors

SERA 8B GA 4bit Parameters and Internals

LLM NameSERA 8B GA 4bit
Repository πŸ€—https://huggingface.co/mlx-community/SERA-8B-GA-4bit 
Base Model(s)  SERA 8B GA   allenai/SERA-8B-GA
Model Size8b
Required VRAM4.6 GB
Updated2026-08-10
Maintainermlx-community
Model Typeqwen3
Model Files  4.6 GB
Quantization Type4bit
Model ArchitectureQwen3ForCausalLM
Context Length40960
Model Max Length40960
Transformers Version4.57.1
Tokenizer ClassQwen2Tokenizer
Padding Token<|endoftext|>
Vocabulary Size151936
Errorsreplace

Best Alternatives to SERA 8B GA 4bit

Best Alternatives
Context / RAM
Downloads
Likes
BehChat SFTv3 Ckpt1128K / 16.4 GB60
BehChat SFTv2 Mixed Ckpt 6128K / 16.4 GB110
...0528 Qwen3 8B Unsloth Bnb 4bit128K / 7.5 GB445713
DeepSeek R1 0528 Qwen3 8B 4bit128K / 4.6 GB17816
...Seek R1 0528 Qwen3 8B Bnb 4bit128K / 6.1 GB9239
Qwen3 8B LQA 14e Full128K / 16.4 GB60
...Seek R1 0528 Qwen3 8B 4bit DWQ128K / 4.6 GB2128
...0528 Qwen3 8B Unsloth Bnb 4bit128K / 16.4 GB70
Annie Lite V0.2.9 Qwen3 8B80K / 16.4 GB50
Bonsai 8B Mlx 1bit64K / 1.3 GB9396221
Note: green Score (e.g. "73.2") means that the model is better than mlx-community/SERA-8B-GA-4bit.