Mundo project team · Customised world model

Mundo: Customized World Model

Mundo is a customised world model that builds an interactive, editable 3D environment from a small set of context images of a real place. It accepts 1 to 12 images for new views along a specified camera path, a single generated image or painting, or dozens of images for camera paths lasting tens of seconds to minutes in large scenes. It reconstructs a 3D proxy of the layout and objects, with physical properties such as mass and friction defined in a scene program. A physics engine (MuJoCo in the examples) computes motion and collisions, and a video model renders the results using the supplied images as visual context. Long paths are generated as a stream of chunks with overlapping temporal windows, with the most relevant context images selected for each chunk. The page demonstrates object interaction, 4D time-freeze views, and robot navigation and manipulation in Real-to-Sim workflows, including a Unitree G1 and a robot dog. No quantitative results, licence, code or release date are given in the page.