Vitruvio:通过单视角草图生成三维建筑网格
Vitruvio: 3D Building Meshes via Single Perspective Sketches
AI总结:
本文提出Vitruvio,首个仅针对建筑的单草图到三维网格深度学习方法,通过适配Occupancy Network在Manhattan 1K上实现推理加速26%和重建精度提升18%,并输出可3D打印的建筑网格。
摘要:
当今的建筑工程与施工(AEC)软件需要一定的学习曲线才能生成三维建筑表示。这限制了快速验证通过单张草图传达的初始设计想法在体量方面的影响的能力。让设计师能够将单张草图转换为三维建筑,将使业主能够即时可视化三维项目信息,而无需承受相应的认知负担。尽管先前最先进的(SOTA)数据驱动单视图重建(SVR)方法在从单张图像或草图进行重建的过程中展示了出色的结果,但它们在AEC领域缺乏具体的应用、分析和实验。因此,本研究填补了这一空白,引入了首个仅关注建筑的深度学习方法,旨在将单张草图转换为三维建筑网格:Vitruvio。Vitruvio将Occupancy Network适配到特定建筑数据集(Manhattan 1K)上的SVR任务。这一适配带来了两项主要改进。第一,它将推理过程加速了超过26%(从0.5秒降至0.37秒)。第二,它将重建精度(以Chamfer Distance衡量)提高了18%。在AEC领域的这一适配过程中,我们评估了建筑朝向在学习过程中的影响,因为它是一个重要的设计因素。虽然将所有建筑对齐到规范姿态改善了整体定量指标,但它未能捕捉更复杂建筑形状中的细粒度细节(如我们的定性分析所示)。最后,Vitruvio从单张透视草图输出一个具有任意拓扑和亏格的可3D打印建筑网格,朝着允许业主和设计师通过一种二维、高效、直观且通用的交流媒介——草图——来传达三维信息迈出了一步。
英文摘要:
Today's architectural engineering and construction (AEC) software require a learning curve to generate a three-dimension building representation. This limits the ability to quickly validate the volumetric implications of an initial design idea communicated via a single sketch. Allowing designers to translate a single sketch to a 3D building will enable owners to instantly visualize 3D project information without the cognitive load required. If previous state-of-the-art (SOTA) data-driven methods for single view reconstruction (SVR) showed outstanding results in the reconstruction process from a single image or sketch, they lacked specific applications, analysis, and experiments in the AEC. Therefore, this research addresses this gap, introducing the first deep learning method focused only on buildings that aim to convert a single sketch to a 3D building mesh: Vitruvio. Vitruvio adapts Occupancy Network for SVR tasks on a specific building dataset (Manhattan 1K). This adaptation brings two main improvements. First, it accelerates the inference process by more than 26% (from 0.5s to 0.37s). Second, it increases the reconstruction accuracy (measured by the Chamfer Distance) by 18%. During this adaptation in the AEC domain, we evaluate the effect of the building orientation in the learning procedure since it constitutes an important design factor. While aligning all the buildings to a canonical pose improved the overall quantitative metrics, it did not capture fine-grain details in more complex building shapes (as shown in our qualitative analysis). Finally, Vitruvio outputs a 3D-printable building mesh with arbitrary topology and genus from a single perspective sketch, providing a step forward to allow owners and designers to communicate 3D information via a 2D, effective, intuitive, and universal communication medium: the sketch.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。