arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2607.03990cs.CV

InSpace:从单张360°图像生成具有结构感知的3D室内场景

InSpace: Structure-Aware 3D Indoor Scene Generation from a Single 360° Image

KAIST(韩国科学技术院);NAVER LABS(NAVER实验室);Chung-Ang University(中央大学)

Gwanhyeong Koo, Hyunsu Kim, Youngji Kim, Taejae Lee, Siwoo Lim, Sunjae Yoon, Suyong Yeon, Chang D. Yoo

AI总结:

针对单图像到3D生成扩展到室内场景有挑战的问题,提出InSpace框架,利用360°图像,经估计部分场景几何、生成粗结构、产生详细布局和资产几何三阶段,还建数据集,实验表明其性能强。

摘要:

单图像到3D生成的进展使高质量资产合成成为可能,但扩展到室内场景生成仍具挑战性。现有方法忽视结构布局,单图像视野有限。为此,我们使用等距投影表示的360°图像,提出InSpace框架,含三个阶段,还提出数据集ERP-FRONT,实验表明InSpace性能良好。

英文摘要:

Recent advances in single image-to-3D generation have enabled high-quality asset synthesis, yet extending these capabilities to indoor scene generation remains challenging. Existing methods focus on asset-level generation while neglecting the structural layout, which is essential for downstream applications and serves as the spatial anchor for grounding assets. However, a single image with a limited field of view lacks the spatial coverage to recover a coherent global layout. To this end, we use a 360° image represented in equirectangular projection (ERP) and propose InSpace, a structure-aware framework for 3D indoor scene generation. InSpace comprises three stages: (1) estimating partial scene geometry as spatial priors, (2) generating coarse scene structure with view-selective cross-attention, and (3) producing detailed layout and asset geometry with textures through a global-local hybrid attention, using flow matching. We also propose ERP-FRONT, a paired ERP-Image-to-3D indoor scene dataset based on 3D-FRONT. Experiments show that InSpace generates complete 3D indoor scenes with structural layout, along with separate textured assets from a single ERP image, achieving strong performance across 3D and 2D metrics. Project Page: https://kookie12.github.io/InSpace-Project-Page/

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑