Tencent · MoE Coding Preview

Hy4-preview

Tencent's next Hunyuan generation after Hy3 in Week 28: a 770B mixture-of-experts activating 49B per token across 78 layers — one dense layer then 77 MoE layers of 256 routed experts plus one shared, top-8 routed — with a 10B MTP layer for speculative decoding, Gated DeepSeek Sparse Attention with IndexCache, and a 1M-token context. Tencent's own blind evaluation puts it fractionally ahead of GLM-5.3 at 2.99 against 2.92 and Kimi K3 at 2.99 against 2.94; GPQA Diamond 92.3, SWE-bench Pro 65.7, Deep SWE 64.3. Apache 2.0, with weights and an FP8 variant openly downloadable.