VideoMDM authors · 3D Reconstruction

VideoMDM

Diffusion framework generating 3D human motion trained only with 2D video supervision: a denoiser recovers clean 3D motion while loss is applied entirely in 2D by reprojecting predictions against keypoints, with depth-aware reprojection weighting proven equivalent in expectation to 3D supervision. 0.88 FID on HumanML3D (vs 0.54 full-3D) and human-preferred on real Fit3D/NBA video.