Article

ZeroDex: Zero-shot long-horizon dexterous manipulation via multi-view 3D-grounded VLM reasoning

ZeroDex is a zero-shot long-horizon dexterous manipulation framework that grounds language instructions into executable 3D task plans from calibrated multi-view RGB images. It leverages the 2D grounding ability VLMs already possess and lifts it to the metric 3D quantities manipulation requires (contact points, placement targets, tool-motion anchors) through multi-view fusion; execution is driven by these 3D groundings rather than a learned policy, requiring no demonstrations or post-training for a specific task or embodiment.

Part of the event: ZeroDex Achieves Zero-Shot Long-Horizon Dexterous Manipulation via Multi-View 3D Grounding

This page provides a summary and source link only.