Article

MotorSense releases first large-scale paired egocentric video and EMG dataset

MotorSense is the first large-scale paired egocentric video and surface electromyography (EMG) dataset, containing synchronized video, bimanual EMG, IMU, and audio across 100 hours of unscripted manipulation. The research uses this data for cross-modal pre-training between video and EMG to learn an action organization shared across visual and motor spaces, and transfers it to tasks including action recognition, 3D hand reconstruction, and 3D contact reconstruction. Across four action-related visual tasks and eight video datasets, this sensorimotor-aligned representation outperforms conventional video self-supervised methods.

Part of the event: MotorSense releases video-EMG paired dataset

This page provides a summary and source link only.