Skip to content

Event

physim-gate v0.3.0 switches to extended bootstrap intervals

1 reports · 1 sources

The statistical gating tool physim-gate released v0.3.0, which by default switches continuous metrics to the Hesterberg extended percentile bootstrap interval, and adds a paired trial planning command, baseline storage, and suite gating, and fixes the GitHub Action. This Action has been run on a real pull request; it can publish a summary and update the same comment on subsequent pushes. The release notes state that the new interval is slightly wider, most noticeably when the number of trials is below about 30, and that some borderline determinations may change from PASS or FAIL to INCONCLUSIVE; 0/1 metrics are unchanged, and setting defaults.bootstrap_method: percentile reproduces the v0.2 results. Its statistical implementation was tested against scipy and statsmodels.

Report timeline

  1. physim-gate v0.3.0 released: defaults to expanded bootstrap intervals and adds planning command

    physim-gate releases v0.3.0, switching the default for continuous metrics to Hesterberg's expanded percentile bootstrap interval.

    GitHub Embodied AI Topic ·

Related topics