arXivDaily arXiv每日学术速递 周一至周五更新
​通知:联邦节假日调休:哥伦布日 / 原住民日(Columbus Day / Indigenous Peoples' Day),今日(13日)无更新。
arXiv 2511.16825cs.CVcs.AI

WorldGen: 从文本到可遍历和交互的3D世界

WorldGen: From Text to Traversable and Interactive 3D Worlds

Reality Labs, Meta(Meta现实实验室)
Dilin Wang, Hyunyoung Jung, Tom Monnier, Kihyuk Sohn, Chuhang Zou, Xiaoyu Xiang, Yu-Ying Yeh, Di Liu, Zixuan Huang, Thu Nguyen-Phuoc, Yuchen Fan, Sergiu Oprea, … 展开作者

Dilin Wang, Hyunyoung Jung, Tom Monnier, Kihyuk Sohn, Chuhang Zou, Xiaoyu Xiang, Yu-Ying Yeh, Di Liu, Zixuan Huang, Thu Nguyen-Phuoc, Yuchen Fan, Sergiu Oprea, Ziyan Wang, Roman Shapovalov, Nikolaos Sarafianos, Thibault Groueix, Antoine Toisoul, Prithviraj Dhar, Xiao Chu, Minghao Chen, Geon Yeong Park, Mahima Gupta, Yassir Azziz, Rakesh Ranjan, Andrea Vedaldi

AI总结:

WorldGen通过结合LLM、程序生成和扩散模型,实现从文本到可交互3D世界的自动创建,提升虚拟空间的生成效率与表现力。

摘要:

我们介绍了WorldGen,一个能够从文本提示自动创建大规模、交互式3D世界系统的工具。我们的方法将自然语言描述转换为可遍历、完全纹理化的环境,可以直接在标准游戏引擎中进行探索或编辑。通过结合LLM驱动的场景布局推理、程序生成、扩散基3D生成以及对象感知的场景分解,WorldGen弥合了创意意图与功能性虚拟空间之间的差距,使创作者能够在无需手动建模或专业3D知识的情况下设计出连贯、可导航的世界。该系统完全模块化,并支持对布局、比例和风格的精细控制,生成的场景在几何上一致、视觉丰富且能够实时高效渲染。这项工作代表了大规模可访问生成世界构建的一个步骤,推动了3D生成AI的前沿,为游戏、模拟和沉浸式社交环境的应用奠定了基础。

英文摘要:

We introduce WorldGen, a system that enables the automatic creation of large-scale, interactive 3D worlds directly from text prompts. Our approach transforms natural language descriptions into traversable, fully textured environments that can be immediately explored or edited within standard game engines. By combining LLM-driven scene layout reasoning, procedural generation, diffusion-based 3D generation, and object-aware scene decomposition, WorldGen bridges the gap between creative intent and functional virtual spaces, allowing creators to design coherent, navigable worlds without manual modeling or specialized 3D expertise. The system is fully modular and supports fine-grained control over layout, scale, and style, producing worlds that are geometrically consistent, visually rich, and efficient to render in real time. This work represents a step towards accessible, generative world-building at scale, advancing the frontier of 3D generative AI for applications in gaming, simulation, and immersive social environments.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑