LLM EXPLORER 65,444 MODELS INDEXED

Hy Memory 30B A3B 8bit by mlx-community

By mlx-community · 115 downloads

Hy Memory 30B A3B 8bit is an open-source language model by mlx-community. Features: 30b LLM, VRAM: 31.8GB, Context: 256K, License: apache-2.0, Quantized.

  Arxiv:2610.22196   8-bit   8bit Base model:quantized:tencent/h... Base model:tencent/hy-memory-3...   Conversational   En   Hy v3   Memory   Mlx   Moe   Quantized   Region:us   Safetensors   Sharded   Tensorflow   Zh

Hy Memory 30B A3B 8bit Parameters and Internals

LLM NameHy Memory 30B A3B 8bit
Repository πŸ€—https://huggingface.co/mlx-community/Hy-Memory-30B-A3B-8bit 
Base Model(s)  Hy Memory 30B A3B   tencent/Hy-Memory-30B-A3B
Model Size30b
Required VRAM31.8 GB
Updated2026-10-24
Maintainermlx-community
Model Typehy_v3
Model Files  5.2 GB: 1-of-6   5.3 GB: 2-of-6   5.3 GB: 3-of-6   5.3 GB: 4-of-6   5.3 GB: 5-of-6   5.4 GB: 6-of-6
Supported Languagesen zh
Quantization Type8bit
Model ArchitectureHYV3ForCausalLM
Licenseapache-2.0
Context Length262144
Model Max Length262144
Transformers Version5.6.0.dev0
Tokenizer ClassTokenizersBackend
Padding Token<|hy_▁padβ–ο½œ>
Vocabulary Size120832

Best Alternatives to Hy Memory 30B A3B 8bit

Best Alternatives
Context / RAM
Downloads
Likes
Hy Memory 30B A3B MLX 4bit256K / 17 GB1572
Hy Memory 30B A3B256K / 50.5 GB2145242
Hy MT2 30B A3B256K / 48 GB178301484
Hy Memory 30B A3B FP8256K / 25.1 GB36013
Hy Memory 30B A3B Exl3 4.08bpw256K / 16 GB1501
Hy Memory 30B A3B AWQ256K / 16.3 GB802
Note: green Score (e.g. "73.2") means that the model is better than mlx-community/Hy-Memory-30B-A3B-8bit.