Article

WorldOracle example: A seemingly successful robot rollout may predict the wrong grasp

WorldOracle presents a case where the real gripper failed to grasp the fruit, but the generated rollout showed the fruit being picked up, despite the model receiving the same initial observation and recorded actions. When evaluating predictions, check separately whether the robotic arm follows the trajectory and whether the object's final state is correct; for an empty grasp, predicting an empty grasp is the correct answer, while a seemingly successful grasp video may actually be wrong.

Part of the event: WorldOracle example: successful rollout may misjudge grasping

This page provides a summary and source link only.