Carnegie Mellon University and Meta · Dense 3D Point Tracking

TrackEverything

A 3D point tracker from CMU and Meta (arXiv, 24 September) that tracks every visible point in long videos, starting each track as soon as a point appears. It stores the video as persistent 3D scene tracks in world coordinates, so cost grows with scene geometry rather than video length; tracks are merged at window boundaries through voxels, a refiner separates static from dynamic points, and full trajectories are decoded only for dynamic ones. The authors say it is the first such tracker to handle videos over 1,000 frames within 40 GB of GPU memory, and report more than 20% better APD on TAPVid-3D than open-source dense 3D trackers, self-reported. A code repo exists while the page still says code is coming.