arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2607.04540cs.GRcs.CV
收藏

SceneFrom3D:通过具有对象级控制的视图调度实现几何条件下的室外3D场景生成

SceneFrom3D: Geometry-Conditioned Outdoor 3D Scene Generation via View Scheduling with Object-Level Control

POSTECH

Geonung Kim, Jeongeun Park, Nuri Ryu, Di Liu, Sunghyun Cho

AI总结:

研究如何进行几何条件下的室外3D场景生成,提出SceneFrom3D框架,自动调度视图,构建生成图,还通过对象级条件控制提升可控性,实验表明该方法达先进水平。

摘要:

几何条件下的3D场景生成可根据用户提供的几何信息创建3D环境。当前方法多采用三阶段设计,定义视图调度是瓶颈。本文提出SceneFrom3D框架,自动调度室外输入几何的视图,构建有向生成图,通过对象级条件控制提升可控性,实验证明其在几何条件下的室外3D场景生成方面达到先进水平。

英文摘要:

Geometry-conditioned 3D scene generation enables the creation of 3D environments from user-provided geometry, offering direct control over scene structure and object layout. To generate such 3D scenes, current methods commonly adopt a three-stage design that first defines a view schedule, then synthesizes multi-view observations along the scheduled views, and finally reconstructs a 3D representation from the generated images. However, defining the view schedule becomes a major bottleneck for outdoor scenes, where large, unstructured, and unbounded geometry makes it difficult to obtain views that provide sufficient coverage while supporting stable generation. To address this bottleneck, we present SceneFrom3D, a framework that automatically schedules views from outdoor input geometries. SceneFrom3D constructs a directed generation graph whose nodes represent anchor views and whose edges represent interpolation trajectories, defining which views to synthesize, which view pairs to interpolate, and in which order generation should proceed. Beyond automatic view scheduling, SceneFrom3D further improves controllability through object-level conditioning, assigning each object an identity image for appearance guidance and a geometry-adherence parameter for region-wise control over the input geometry. Experiments demonstrate that SceneFrom3D achieves state-of-the-art geometry-conditioned outdoor 3D scene generation, producing high-quality scenes with controllable object appearance and geometry adherence.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑