LLM EXPLORER 59,805 MODELS INDEXED

Hy4 Preview by tencent

By tencent · 1394 downloads
HF Repo ↗ Copy URL

Hy4 Preview is an open-source language model by tencent. Features: 780b LLM, VRAM: 772GB, Context: 1024K, License: apache-2.0, LLM Explorer Score: 0.49.

  Arxiv:2512.02556   Arxiv:2603.12201   Conversational   Endpoints compatible   Eval-results   Hunyuan   Hy4   Hy v4   Moe   Region:us   Safetensors   Sharded   Tensorflow
Model Card on HF 🤗: https://huggingface.co/tencent/Hy4-preview 

Hy4 Preview Parameters and Internals

LLM NameHy4 Preview
Repository 🤗https://huggingface.co/tencent/Hy4-preview 
Model Size780b
Required VRAM772 GB
Updated2026-08-29
Maintainertencent
Model Typehy_v4
Model Files  19.3 GB: 1-of-131   19.3 GB: 2-of-131   19.3 GB: 3-of-131   19.3 GB: 4-of-131   19.3 GB: 5-of-131   19.3 GB: 6-of-131   19.3 GB: 7-of-131   19.3 GB: 8-of-131   19.3 GB: 9-of-131   19.3 GB: 10-of-131   19.3 GB: 11-of-131   19.3 GB: 12-of-131   19.3 GB: 13-of-131   19.3 GB: 14-of-131   19.3 GB: 15-of-131   19.3 GB: 16-of-131   19.3 GB: 17-of-131   19.3 GB: 18-of-131   19.3 GB: 19-of-131   19.3 GB: 20-of-131   19.3 GB: 21-of-131   19.3 GB: 22-of-131   19.3 GB: 23-of-131   19.3 GB: 24-of-131   19.3 GB: 25-of-131   19.3 GB: 26-of-131   19.3 GB: 27-of-131   19.3 GB: 28-of-131   19.3 GB: 29-of-131   19.3 GB: 30-of-131   19.3 GB: 31-of-131   19.3 GB: 32-of-131   19.3 GB: 33-of-131   19.3 GB: 34-of-131   19.3 GB: 35-of-131   19.3 GB: 36-of-131   19.3 GB: 37-of-131   19.3 GB: 38-of-131   19.3 GB: 39-of-131   19.3 GB: 40-of-131
Model ArchitectureHYV4ForCausalLM
Licenseapache-2.0
Context Length1048576
Model Max Length1048576
Transformers Version5.16.2
Vocabulary Size120832
Torch Data Typebfloat16