arXiv cs.RO· Yiyang Du, Zhanqiu Guo, Haochen Zhang, Annabella Macaluso, Xin Ye, Liu Ren, Yonatan Bisk, Chenyan Xiong·· 4 小时前AI 评分59
EmbodiedMidtrain:用中训练弥合视觉语言模型与VLA之间的差距
EmbodiedMidtrain: Bridging the Gap between Vision-Language Models and Vision-Language-Action Models via Mid-training
AI 导读
论文提出EmbodiedMidtrain,通过中训练弥合视觉语言模型(VLM)与视觉-语言-动作模型(VLA)之间的差距。作者先刻画两者数据分布差异,发现VLA数据占据与VLM分布大体分离的紧凑区域,随后构建中训练数据引擎,用轻量可学习的邻近度估计器从大规模VLM池中筛选与VLA最对齐的候选,产出EmbodiedMidtrain-1M数据集用于中训练VLM。
来源:arXiv cs.RO · arxiv.org