Article

Video-Point Model learns 4D world through point trajectory prediction, improving robot manipulation success rate

The paper proposes Video-Point Model (VPM), a world model that conditions on multi-view video histories and language instructions to jointly predict future videos from arbitrary viewpoints and the 3D trajectories of persistent scene points. The authors add camera-conditioned multi-view processing and a trajectory prediction head to a pretrained world model, and build the VPM-Data simulation corpus and the VP-WorldBench benchmark; they further add robot actions as a token modality in the generator, so that the policy shares the point-supervised backbone.

Part of the event: VPM World Model Jointly Predicts Video and Point Trajectories

This page provides a summary and source link only.