CUHK MMLab & ByteDance · Text-to-Video

InterActHuman

A diffusion transformer framework for audio-driven multi-person video generation that uses iterative mask prediction to localize and align multi-modal inputs for each subject, enabling precise lip-sync and identity-specific audio conditioning. Supports dialogue videos, human-object interactions, and multi-concept customization across diverse domains including cartoons and animals.