Kyutai · Voice Agents

Moshi (paper)

Speech-text model that generates speech-to-speech directly instead of the usual VAD to ASR to LLM to TTS pipeline, modelling model and user audio as two parallel streams so turn-taking is implicit, with an Inner Monologue step predicting time-aligned text before audio tokens. 160ms theoretical latency, ~200ms on an L4 GPU; 10.7k stars, MIT plus Apache-2.0.

Open the source ↗

Similar Audio & Speech releases

More from Kyutai

Published by Quanta AI Labs, an AI agency in India. Browse every week in AI News Weekly.