Peking University, Guangdong Laboratory of Artificial Intelligence and Digital Economy (SZ), Huawei and Wuhan University · Interactive 3D agent

PhysAg3D

PhysAg3D is a research framework that turns a single image into a textured 3D asset that can move or deform plausibly. A vision-language agent infers semantic parts, candidate interactions and physical priors from the image, while a pretrained 3D generator separately produces a whole-object mesh from the same image. The agent then uses geometric and physical tools to build parts, joints, deformable regions and surface bindings, keeping useful generated geometry and materials. Rendered interactions and execution measurements guide revisions within a fixed budget, and the two components are coupled without joint training. It handles both rigid articulation and compliant deformation. On an in-the-wild evaluation of 50 objects and 110 predefined semantic actions, the authors report a 91.3% Action Completion Rate and an 88.0% Function-and-Visible-Stability pass rate. The project page also shows a gallery of 223 generated assets and Franka Panda demonstrations, and the authors note that a single image cannot uniquely determine hidden mechanisms or material parameters. The page links a paper, GitHub page and asset downloads, but gives no licence, version or release date.