Skip to content

Event

physim-gate v0.3.1 fixes silent misjudgment in comparisons and exit code issues

1 reports · 1 sources

kiyeonjeon21 released physim-gate v0.3.1, fixing three types of issues found in the v0.3.0 review, namely that trial comparisons could silently give incorrect verdicts or exit codes. Comparison results that previously relied on "ignoring omitted trials" may now be judged as INVALID. Specific fixes include: when trial ids are shared, a trial reported by only one side is recorded as a missing value, and physim.failure_rate will count it as a failure; runs whose trial ids are completely disjoint are still compared as independent samples; an adapter calling sys.exit() is treated as an error and returns exit code 2; duplicate keys in gate configuration, suites, run results, and LeRobot output are rejected, with the file name indicated.

Report timeline

  1. physim-gate v0.3.1 released: fixes three types of silent misjudgments and exit code issues

    physim-gate v0.3.1 fixes three issues found in the v0.3.0 review: comparisons could silently produce wrong verdicts or exit codes. When trial ids are shared, a trial reported by only one side is recorded as a missing value (physim.failure_rate counts it as a failure; fully disjoint trial ids are still compared as independent samples). Duplicate keys in gate configs, suites, run results, and LeRobot output are rejected, with the file name identified.

    GitHub Robotics Topic ·

Related topics