AI 中文总结
HoloWorld是首个统一室内-室外生成的3D城市世界框架,通过跨尺度语境实现对应,在城市外部生成上优于SOTA,且保持室内外对应与跨街区连续性。
AI 中文摘要
文本驱动的3D生成在创建大规模室外环境和精细室内场景方面已取得快速进展,但这些领域通常是独立合成的,缺乏构建连贯城市世界所需的对应关系。我们提出HoloWorld,这是一个基于持续更新的跨尺度世界语境的统一室内-室外城市世界生成框架。从用户描述初始化开始,HoloWorld逐步表示并更新从城市尺度规划到单个建筑的各类世界信息,使生成的室内空间能与相关的外部建筑保持明确对应。在不断演变的语境和先前生成的相邻街区的条件下,HoloWorld自回归生成具有跨街区一致空间组织和视觉特征的城市外部场景。生成的外部场景表示进一步基于3D建筑实例和 footprint( footprint 指建筑 footprint,即建筑占地轮廓),支持具有几何约束布局和继承外观特征的特定建筑室内生成。据我们所知,HoloWorld是首个在连贯3D城市世界内统一室内和室外生成的框架。大量实验表明,HoloWorld在城市外部场景生成性能上表现优异,相比现有最优方法(SOTA)将平均AQS分数提升了7.68%,并获得最高的平均RDR分数,同时在统一3D城市世界内保持了强大的建筑级室内-室外对应关系和跨街区连续性。
英文摘要
Text-driven 3D generation has advanced rapidly in creating large-scale outdoor environments and detailed indoor scenes, but these domains are usually synthesized independently, lacking the correspondence required for a coherent urban world. We present HoloWorld, a unified indoor-outdoor urban world generation framework built on a continuously updated cross-scale world context. Initializing from a user description, HoloWorld progressively represents and updates the diverse world information, from city-scale planning to individual buildings, allowing generated interiors to maintain explicit correspondence with their associated exterior buildings. Conditioned on the evolving context and previously generated neighboring blocks, HoloWorld autoregressively generates urban exteriors with consistent spatial organization and visual identity across blocks. The generated exterior representations are further grounded in 3D building instances and footprints, enabling building-specific indoor generation with geometry-constrained layouts and inherited appearance characteristics. To our knowledge, HoloWorld is the first framework to unify indoor and outdoor generation within a coherent 3D urban world. Extensive experiments demonstrate that HoloWorld achieves superior urban exterior generation performance, improving the average AQS score over the SOTA by 7.68\% and obtaining the highest average RDR score, while maintaining strong building-level indoor-outdoor correspondence and cross-block continuity within a unified 3D urban world. Our project page: https://huangxb326.github.io/HoloWorld/.
Comments9 pages, 4 figures