# When Does Experience Memory Actually Help Closed-Loop LLM Driving Agents? A Controlled Evaluation

- Source: arXiv cs.RO
- Published: 2026-10-21T04:00:00.000Z
- RoboHot: https://robohot.news/en/items/jipij13lpms4jiugdi30nvsx8
- Original: https://arxiv.org/abs/2610.27714

## Summary

A controlled evaluation on the HighwayEnv testbed (1Hz, with gpt-4o-mini used for the key comparisons) shows that the published gains from experience memory in closed-loop LLM driving agents mainly come from sampling luck in the warmup pool: retrieval-based memory beat No-Memory in only one of ten pools (sign test p=0.011).