MATE: Asynchronous Multi-Rate Diffusion Policy Composition Framework
The authors propose LAG-Fusion, a latency-aware guidance fusion framework for asynchronous multimodal diffusion policy composition that allows modality-specific policies to run at their own inference rates and provide denoising guidance whenever output is available. To keep asynchronous composition consistent, the authors derive a reference-frame rebasing rule for diffusion variables under relative action representations, so that delayed guidance is aligned before fusion. In contact-rich manipulation, the authors compose a low-frequency vision policy with a high-frequency force policy; experiments with heterogeneous modality latency show better responsiveness and task performance than synchronous fusion and a purpose-designed force-aware baseline.
This page provides a summary and source link only. Read the full article at the source.
Source: arXiv cs.RO · arxiv.org
Part of the event: LAG-Fusion: An Asynchronous Multimodal Diffusion Policy Fusion Framework