Article

ArtifactArena: Evaluating models by the robots they build in the physical world

ArtifactArena is an open-ended evaluation platform that challenges models with hardware-software co-design: building working robots in a simulated arena and pitting them against each other. The platform guides models to improve their robot artifacts through three channels: text descriptions, physics simulator feedback, and gameplay data, and compares frontier models using Elo rankings from head-to-head tournaments. The authors are releasing the framework and tournament infrastructure for ongoing community submissions, creating a non-saturating long-term testbed.

Part of the event: ArtifactArena releases a robot physics evaluation platform

This page provides a summary and source link only.