Baidu ERNIE Research · Text-to-Video

NAVA

6.3B-parameter Native Audio-Visual Alignment framework with an Align-then-Fuse MMDiT that first builds audio-video correspondence in an interaction space then conditions joint denoising on external context; produces 720p stereo synchronized audio-video in ~1 min on 8 GPUs with Ulysses sequence parallel.

Open the source ↗

Similar Video & Animation releases

Published by Quanta AI Labs, an AI agency in India. Browse every week in AI News Weekly.