Article

OSMA-Bench: Evaluating Safety Under Obstacle Conditions in Household Robot Navigation

The authors propose OSMA-Bench, a benchmark that uses spatially matched scenario sets differing only in obstacle type to test whether robot navigation adjusts clearance and speed according to obstacle semantics, and they propose the Semantic Sensitivity Index (SSI) to measure this adaptation. Evaluating VLM and vision-language-action (VLA) policies on the benchmark, they find that even with explicit safety prompts, neither consistently adjusts its motion according to obstacle safety levels.

Part of the event: OSMA-Bench and SSI Evaluate Home Robot Obstacle Avoidance Safety

This page provides a summary and source link only.