Event
Team switches to frontier large models for robot control in customer deployment
1 reports · 1 sources
A team says that over the past month, in a customer deployment, it fully switched robot control to be driven by frontier large models: high-level reasoning is handled by agents based on Opus and Astra, and the fast execution layer uses computer vision code written by the models themselves, which they describe as fast, editable, and reliable. The team also says that large models bring in-context learning and continual learning, and that when new situations arise, the large models step in and adjust the process.
Report timeline
- Team fully switches to frontier LLMs for robot control in customer deployments
A team fully switched to using frontier LLMs to control robots in customer deployments over the past month. The architecture resembles a System 1/System 2 division of labor: high-level reasoning is handled by agents based on Opus and Astra, while the fast execution layer uses computer vision code written by the models themselves, which they describe as fast, editable, and reliable. LLMs also bring in-context learning and continual learning; when new situations arise, the LLM steps in and adjusts the process.
Reddit r/robotics ·