Skip to content

Article

EgoTac: Predicting In-the-Wild Touch from Egocentric Vision

arXiv cs.RO

EgoTac is a generalizable model that predicts rich tactile information directly from egocentric human videos. It was trained on more than 5.7 million image-tactile pairs covering both continuous force measurements and binary contact. Experiments show an average force error below 0.06N for in-domain prediction, and on out-of-domain contact prediction benchmarks it consistently outperforms the current state-of-the-art contact estimator. It also enables zero-shot prediction on unconstrained real-world videos; scaling analysis indicates that both data diversity and data volume steadily improve performance. The work was accepted to NeurIPS 2026.

Part of the event: Release of the EgoTac visual-to-tactile prediction model

This page provides a summary and source link only.