Tencent Hunyuan Open Hy4 Weight, supporting millions of Token context
The Tencent Hunyuan team has released the model weights of the native multimodal flagship model Hy4. Hy4 adopts a mixture of experts (MoE) architecture, with a total parameter count of 770 billion, activating 49 billion parameters per token, and a context length of 1 million tokens.
The Tencent Hunyuan team also released the Hy4 system card, which includes a security assessment report, and plans to hold an online Q&A in the r/LocalLLaMA community on Reddit from 8 AM to 10 AM Pacific Time on Friday to address questions regarding the Hy series models.
Related tags






