MagicLab analyzes Magic-Brain's in-context visual guidance design; magicVLA grasp success rate rises from 70% to 94.4%
MagicLab introduces the visual guidance approach in the Magic-Brain framework: a VLM Agent outputs a bbox, and a segmentation model refines it into a three-color mask overlaid on the observation image, converting semantic guidance into visual guidance.
Why it matters: MagicLab details the design motivation and implementation of Magic-Brain's visual guidance layer, letting readers understand the impact on grasp success rate of converting language instructions into pixel guidance.