LLM EXPLORER 59,962 MODELS INDEXED

Hy4 Preview FP8 by tencent

By tencent · 1469 downloads
HF Repo ↗ Copy URL

Hy4 Preview FP8 is an open-source language model by tencent. Features: 803.5b LLM, VRAM: 400GB, Context: 1024K, License: apache-2.0, LLM Explorer Score: 0.39.

  Arxiv:2512.02556   Arxiv:2603.12201   Conversational   Endpoints compatible   Fp8   Hunyuan   Hy4   Hy v4   Modelopt   Moe   Quantized   Region:us   Safetensors   Sharded   Tensorflow
Model Card on HF 🤗: https://huggingface.co/tencent/Hy4-preview-FP8 

Hy4 Preview FP8 Parameters and Internals

LLM NameHy4 Preview FP8
Repository 🤗https://huggingface.co/tencent/Hy4-preview-FP8 
Model Size803.5b
Required VRAM400 GB
Updated2026-08-30
Maintainertencent
Model Typehy_v4
Model Files  10.0 GB: 1-of-130   10.0 GB: 2-of-130   10.0 GB: 3-of-130   10.0 GB: 4-of-130   10.0 GB: 5-of-130   10.0 GB: 6-of-130   10.0 GB: 7-of-130   10.0 GB: 8-of-130   10.0 GB: 9-of-130   10.0 GB: 10-of-130   10.0 GB: 11-of-130   10.0 GB: 12-of-130   10.0 GB: 13-of-130   10.0 GB: 14-of-130   10.0 GB: 15-of-130   10.0 GB: 16-of-130   10.0 GB: 17-of-130   10.0 GB: 18-of-130   10.0 GB: 19-of-130   10.0 GB: 20-of-130   10.0 GB: 21-of-130   10.0 GB: 22-of-130   10.0 GB: 23-of-130   10.0 GB: 24-of-130   10.0 GB: 25-of-130   10.0 GB: 26-of-130   10.0 GB: 27-of-130   10.0 GB: 28-of-130   10.0 GB: 29-of-130   10.0 GB: 30-of-130   10.0 GB: 31-of-130   10.0 GB: 32-of-130   10.0 GB: 33-of-130   10.0 GB: 34-of-130   10.0 GB: 35-of-130   10.0 GB: 36-of-130   10.0 GB: 37-of-130   10.0 GB: 38-of-130   10.0 GB: 39-of-130   10.0 GB: 40-of-130
Model ArchitectureHYV4ForCausalLM
Licenseapache-2.0
Context Length1048576
Model Max Length1048576
Transformers Version5.16.2
Vocabulary Size120832
Torch Data Typebfloat16