Event
X Square Robot releases X2Real simulation evaluation benchmark
2 reports · 2 sources
X Square Robot released the simulation evaluation benchmark X2Real, along with its dataset and evaluation platform, for assessing the performance of embodied models in the real physical world. X Square Robot states that in testing, the correlation between X2Real simulation evaluation and real-machine evaluation reached 0.96 for task success rate and 0.99 for progress score. Models participating in the test must first undergo post-training on the nearly 300-hour dataset provided by X2Real; this dataset was collected in a unified green-screen studio and is isolated from the evaluation environment. Platform calibration covers embodiments including the single-arm Franka, the dual-arm ArtiXon Arm-6A, the ARX R5, and the mobile manipulation platform Quanta X1; developers do not need to set up a simulation environment locally—after connecting to the unified model interface and running the inference service locally, the platform can complete evaluation scoring and trajectory replay online.
Report timeline
- X Square Robot releases X2Real simulation benchmark, with 0.96 correlation between simulated and real-robot task success rates
X Square Robot released the X2Real simulation benchmark for evaluating the performance of embodied models in the real physical world, proposing three design principles: credibility, validity, and objectivity. In testing, X2Real simulation evaluation achieved a 0.96 correlation with real-robot evaluation in task success rate and a 0.99 correlation in progress score; control parameter calibration achieved millimeter-level trajectory consistency, covering embodiments including Franka, ArtiXon Arm-6A, ARX R5, and Quanta X1.
雷科技 ·
- X Square Robot releases X2Real simulation benchmark, with 0.96 correlation between simulated and real-robot task success rates
X Square Robot has released X2Real, an evolvable simulation evaluation benchmark. Its simulated evaluation and real-robot evaluation achieve a task success rate correlation of 0.96 and a progress score correlation of 0.99.
自变量机器人 · 微信公众号 ·