# Beyond Success Rate: Interventional Evaluation of Memory in Vision-Language-Action Systems

- Source: arXiv cs.RO
- Published: 2026-10-19T04:00:00.000Z
- RoboHot: https://robohot.news/en/items/v903rsacbiunk6ivxdxvn27gd
- Original: https://arxiv.org/abs/2610.23372

## Summary

The paper proposes an Interventional Memory Evaluation Protocol (IMEP) for vision-language-action (VLA) systems, used to determine whether memory truly influences robot decision-making, covering four questions: the net benefit of memory, the conditions under which it takes effect, changes to task outcomes, and whether the effects are specific to task-relevant facts.