Event
RoboCap Releases Six-Camera Head-Mounted Platform and Grounded API
1 reports · 1 sources
The research team led by Qasim Ali has released the RoboCap technical report, introducing a 250-gram head-mounted device equipped with six cameras and dual IMUs for in-the-wild first-person data collection, along with a device-agnostic 3D algorithm suite, the Grounded API, covering SLAM, first-person depth estimation, and hand tracking. The report states that the combination of hardware, calibration, and 3D algorithms achieves current state-of-the-art performance on public benchmarks, and that its hand tracking, after adaptation to third-party devices, also reaches this level.
Report timeline
- RoboCap: A six-camera head-mounted platform and Grounded API for egocentric robot learning
The research team introduces RoboCap, a 250-gram head-mounted device with six cameras and dual IMUs for in-the-wild egocentric data collection, along with the Grounded API, a device-agnostic suite of 3D algorithms. The report shows how the hardware, calibration, and 3D algorithms work together to achieve state-of-the-art performance on public benchmarks, covering SLAM across diverse settings and rigs, egocentric depth estimation, and hand tracking when adapted to third-party devices.
arXiv cs.RO ·