Featured

Dexmate and CMU Release MeMoREval Benchmark: Robot Storing Camera Frames Beats Text Descriptions

Dexmate and CMU introduced the MeMoREval benchmark, which uses a two-stage protocol of experiencing first and asking questions later to evaluate what embodied agents should store as memory. It includes 53 tasks and 4 simulated indoor environments, and runs on the Vega 1 Pro dual-arm mobile manipulator. Results show that storing raw camera frames scored 70% and had lower write cost, surpassing text descriptions at 56 to 60%; adding scene graphs achieved the highest overall success rate among all tested models. The protocol also completed two memory retrieval demonstrations on a real Vega 1 Pro using a SLAM map and head camera.

Part of the event: Dexmate and CMU Release MeMoREval Memory Benchmark

This page provides a summary and source link only.