Skip to content

Event

EMMA Enhances VLA Policy Generalization with Generated Visual Data

1 reports · 1 sources

Zhehao Dong et al. propose the EMMA framework, which uses a generative data engine and training pipeline to augment training data for vision-language-action (VLA) policies, alleviating the high cost of collecting robot manipulation data across appearances. Its core component, DreamTransfer, is based on a diffusion Transformer and generates multi-view-consistent, geometrically plausible manipulation videos; it can perform text-driven editing of foreground, background, and lighting while preserving 3D structure. The paper reports that under zero-shot visual settings on real robot tasks, the framework achieves over 92% relative performance improvement compared with training on real data only, and adding the AdaMix training strategy yields an additional 17% improvement; AdaMix adaptively weights samples according to policy performance, focusing on harder samples.

Report timeline

  1. EMMA framework uses generative visual models to improve visual generalization of VLA manipulation policies

    The EMMA framework enhances vision-language-action (VLA) policies through a generative data engine and training pipeline, addressing the high cost of collecting robot manipulation data across varied appearances. Its core component, DreamTransfer, is based on a diffusion Transformer and generates multi-view-consistent, geometrically plausible manipulation videos, supporting text-driven editing of foreground, background, and lighting while preserving 3D structure.

    arXiv cs.RO ·

Related topics