arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2405.03520cs.CV
收藏

Sora是世界模拟器吗?通用世界模型及相关领域综合综述

Is Sora a World Simulator? A Comprehensive Survey on General World Models and Beyond

Zheng Zhu, Xiaofeng Wang, Wangbo Zhao, Chen Min, Bohan Li, Nianchen Deng, Min Dou, Yuqi Wang, Botian Shi, Kai Wang, Chi Zhang, Yang You, Zhaoxiang Zhang, Dawei … 展开作者

Zheng Zhu, Xiaofeng Wang, Wangbo Zhao, Chen Min, Bohan Li, Nianchen Deng, Min Dou, Yuqi Wang, Botian Shi, Kai Wang, Chi Zhang, Yang You, Zhaoxiang Zhang, Dawei Zhao, Liang Xiao, Jian Zhao, Jiwen Lu, Guan Huang

AI总结:

本综述围绕Sora引发的世界模型研究热潮,全面梳理视频生成、自动驾驶、自主智能体等领域的世界模型最新进展,分析其挑战与未来方向,为相关研究提供参考。

摘要:

通用世界模型是实现通用人工智能(AGI)的关键路径,是从虚拟环境到决策系统等各类应用的基石。近期,Sora模型的出现因其卓越的模拟能力受到广泛关注,展现出对物理定律的初步理解。本综述对世界模型的最新进展展开全面探究:我们分析了视频生成领域的前沿生成方法,其中世界模型是合成高度真实视觉内容的核心架构;此外,我们审视了蓬勃发展的自动驾驶世界模型领域,细致阐述了其在重塑交通与城市出行方面不可或缺的作用;进一步地,我们深入探讨了部署在自主智能体中的世界模型的内在复杂性,阐明了其在动态环境中实现智能交互的深远意义。最后,我们考察了世界模型的挑战与局限性,并讨论了其潜在的未来方向。我们希望本综述能为研究界提供基础参考,激发持续创新。本综述将定期更新,地址为:https://github.com/GigaAI-research/General-World-Models-Survey。

英文摘要:

General world models represent a crucial pathway toward achieving Artificial General Intelligence (AGI), serving as the cornerstone for various applications ranging from virtual environments to decision-making systems. Recently, the emergence of the Sora model has attained significant attention due to its remarkable simulation capabilities, which exhibits an incipient comprehension of physical laws. In this survey, we embark on a comprehensive exploration of the latest advancements in world models. Our analysis navigates through the forefront of generative methodologies in video generation, where world models stand as pivotal constructs facilitating the synthesis of highly realistic visual content. Additionally, we scrutinize the burgeoning field of autonomous-driving world models, meticulously delineating their indispensable role in reshaping transportation and urban mobility. Furthermore, we delve into the intricacies inherent in world models deployed within autonomous agents, shedding light on their profound significance in enabling intelligent interactions within dynamic environmental contexts. At last, we examine challenges and limitations of world models, and discuss their potential future directions. We hope this survey can serve as a foundational reference for the research community and inspire continued innovation. This survey will be regularly updated at: https://github.com/GigaAI-research/General-World-Models-Survey.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑