Article

SMR: Learning streaming motion retargeting for humanoids from human semantics

SMR is a streaming neural motion retargeter learned from semantic-conditioned physics experts. It converts human motion into robot task-space targets, which the physics experts track in simulation, and then uses a strictly causal Transformer to learn their executed trajectories. Each new frame uses only current and past human observations to generate a robot motion reference for a downstream whole-body controller. Experiments show that the semantic-conditioned physics experts outperform direct-optimization retargeting in semantic fidelity and physical validity, and that the resulting streaming retargeter performs better in closed loop under a unified whole-body controller than kinematic and physics-refinement baselines.

Part of the event: SMR: Learning Humanoid Streaming Motion Retargeting from Semantically Conditioned Physics Experts

This page provides a summary and source link only.