Event

Study: LeWM has limited local action geometry fidelity

1 reports · 1 sources

Vasil Vasilev and Siddharth Nayak published a paper using matched simulator and model responses to measure the sensitivity of LeWorldModel (LeWM) to small action perturbations via Gram matrices across nearly a thousand states in Reacher and OGBench Cube. Results show that at the smallest perturbation scale, the median angle between the most sensitive action directions of the model and the simulator is approximately 36° and 42°, respectively, i.e., LeWM does not precisely reproduce local action geometry. The authors accordingly argue for evaluating action sensitivity separately by perturbation scale, and state that the impact of this deviation on control remains an open question.