PyRUA-DataFarm: Using LLM agents instead of teleoperation to generate real-ready robot data
PyRUA-DataFarm proposes having a coding agent rebuild tasks in simulation, with a video model rendering them into real-ready data, replacing teleoperation for collecting robot demonstrations. On five real-robot tasks, policies trained only on this data achieved 93/100 successes, versus 84/100 for policies trained on teleoperated data; under an unseen tablecloth and colored lighting, the former kept 87 successes while the latter fell to 46.
Why it matters: The paper presents a complete pipeline and cost comparison for using a coding agent to replace teleoperation in collecting demonstrations, which can be used to assess the room for replacing this data-collection route.