Tencent Hunyuan · Simultaneous speech translation

Hy-SimulMT

Hy-SimulMT is a real-time simultaneous translation model from Tencent Hunyuan. It handles bidirectional speech-to-speech translation between Chinese and English, translating incoming audio as the speaker talks and producing both text and speech, with real-time voice cloning to preserve the speaker's vocal characteristics. On the RealSI long-form audio benchmark it reached a StreamLAAL of about 3 seconds, the lowest of the systems compared, and its GEMBA score exceeded those of the compared open-source models and four of the five commercial APIs. On four short-form benchmarks it scored 90.3 on FLEURS, 75.5 on CoVoST2, 81.2 on ACL6060 and 84.7 on RealSI-Sentence, the highest listed result on the last. In a small test of 18 recordings of about six minutes each against six professional interpreters (CATTI Level 1 and 2), Tencent reports comparable translation quality and often lower latency, and notes the findings apply only to that test. The repository provides the SimulInfer inference service and SimulTrain training tools; speech output and voice cloning need a configured TTS service. It was announced on 26 October 2026, has 188 stars and no formal releases, the licence is not stated (NOASSERTION), and the model is also available in the Hy Translate App.