Event

Open-source tool roboreview shortens factory video annotation time

1 reports · 1 sources

AI engineer u/its_all_in_mind posted the open-source tool roboreview on Reddit r/robotics, used to annotate first-person factory videos captured with a head-mounted camera for robot imitation learning, compressing the annotation time for a 5-minute clip from 40-50 minutes to 5 minutes. The workflow first uses a small model to predict each step, then confirms or fine-tunes the start and end points one by one in a review app, and the review results are exported as training data and used to retrain the model. The developer says that on a clip the model had never seen, the model predicted nearly 93% of frames and found all 12 shirts; the model was trained on only 30 minutes of video, which also included a large amount of non-working time. He also notes that currently only one worker and one task are involved, and the labels were reviewed only by himself, with the entire workflow running on his M1 Pro laptop, and the code has been open-sourced.