# Dexmate and CMU Release MeMoREval Benchmark: Robot Storing Camera Frames Beats Text Descriptions

- Source: Dexmate
- Published: 2026-10-14T18:00:00.000Z
- RoboHot: https://robohot.news/en/items/pxk1wtw8ocfd9u4p6afwyduky
- Original: https://www.dexmate.com/blog/what-should-a-robot-remember

## Summary

Dexmate and CMU introduced the MeMoREval benchmark, which uses a two-stage protocol of experiencing first and asking questions later to evaluate what embodied agents should store as memory. It includes 53 tasks and 4 simulated indoor environments, and runs on the Vega 1 Pro dual-arm mobile manipulator. Results show that storing raw camera frames scored 70% and had lower write cost, surpassing text descriptions at 56 to 60%; adding scene graphs achieved the highest overall success rate among all tested models. The protocol also completed two memory retrieval demonstrations on a real Vega 1 Pro using a SLAM map and head camera.

## Why it matters

The benchmark was proposed jointly by the platform developer and CMU; its frame-versus-scene-graph comparison can help with memory design choices, and the real-robot transfer offers a feasibility reference.