AW-0 represents robot skills as short programs that can be reused across tasks. While writing a program, the model also predicts the camera views and motor commands for the next steps. The authors tested this combination in RoboTwin 2.0 and on two-arm manipulation tasks with physical robots.
Figure 1 from the paper, by Zhuoyang Liu and coauthors, licensed under CC BY 4.0.
* Equal contribution. † Equal advising.