Kuaishou Technology (Kling Team), Renmin University of China, Tsinghua University · Video Editing

OmniSync

Universal lip synchronization framework using Diffusion Transformers with mask-free training, progressive noise initialization, and Dynamic Spatiotemporal Classifier-Free Guidance to maintain identity consistency while precisely editing mouth regions. Introduces AIGC-LipSync Benchmark for evaluating lip sync in AI-generated videos across diverse visual scenarios including stylized characters and occluded faces.