arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2607.03461cs.CVcs.LG
收藏

WorldBagel:揭示统一多模态模型在视觉-语言-动作-世界建模中的力量

WorldBagel: Uncovering the Power of Unified Multimodal Models for Vision-Language-Action-World Modeling

Georgia Institute of Technology(佐治亚理工学院)

Zelin Zhao, Min Shi, Bo Yuan, Haotian Xue, Jialuo Li, Lama Moukheiber, Humphrey Shi, Yongxin Chen

AI总结:

研究统一多模态模型在视觉-语言-动作-世界建模中的作用,基于BAGEL构建WorldBagel框架,通过多任务机器人操作等实验,发现统一不仅便利,更是学习有效模型的关键因素。

摘要:

世界模型旨在以支持感知、推理和行动的方式捕捉环境动态,已成为视觉-语言-动作-世界(VLAW)建模的核心方向。统一视觉语言模型有强大多模态生成能力,但其作为世界模型的潜力未被充分探索。本文介绍基于BAGEL的统一VLAW框架WorldBagel,研究统一在世界建模中的作用,实验表明统一是关键因素。

英文摘要:

World models aim to capture environment dynamics in ways that support perception, reasoning, and action, and have recently become a central direction in Vision-Language-Action-World (VLAW) modeling. Meanwhile, unified vision-language models have demonstrated strong multimodal generation capabilities, yet their potential as world models remains underexplored. In this work, we introduce \texttt{WorldBagel}, a unified VLAW framework built on BAGEL, a modern multimodal unified model, and use it to systematically investigate the role of unification in world modeling. Across multi-task robotic manipulation and cross-domain experiments, \texttt{WorldBagel} consistently outperforms task-specific alternatives and learns action representations that are more structured and semantically aligned with visual and linguistic context. Experiments on LIBERO, Language Table, and Franka show that unification is not only an architectural convenience, but also a key factor in learning effective VLAW models, leading to consistent empirical gains and deeper insights into multimodal world modeling. Code and model checkpoints will be released upon acceptance.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑