Article

DreamTacVLA: A VLA framework that uses a tactile world model to predict future contact

DreamTacVLA proposes a framework that grounds VLA models in contact physics, learning contact dynamics by predicting future tactile signals. The model uses hierarchical perception, taking high-resolution tactile images as micro-vision inputs combined with wrist-camera local vision and third-person macro vision, and uses a Hierarchical Spatial Alignment (HSA) loss to align tactile tokens with their spatial counterparts in the wrist and third-person views.

Part of the event: DreamTacVLA: Predicting Future Contact with a Tactile World Model

This page provides a summary and source link only.