arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2404.01248cs.CV
收藏

基于透视成像的可扩展场景建模:基于物理的外观与几何推断

Scalable Scene Modeling from Perspective Imaging: Physics-based Appearance and Geometry Inference

The Ohio State University(俄亥俄州立大学)

Shuang Song

AI总结:

本论文提出三种基于物理建模的新方法,结合深度学习、计算几何与摄影测量学,实现大规模高精度三维场景外观与几何推断,兼顾可扩展性与方法通用性。

摘要:

三维场景建模技术是地理空间工程和计算机科学的基石,推动着从自动驾驶、地形测绘、导航到虚拟、增强、混合和扩展现实(用于游戏和电影行业等)等众多应用的发展。本论文介绍了在三维场景建模的外观和几何建模方面推动其达到当前最先进水平的部分贡献。与主流的深度学习方法不同,作为核心贡献,本论文旨在开发遵循第一性原理的算法,在引入复杂的基于物理的模型的同时,配合更简单的学习和推断任务。这些算法的成果所产生的流程能够消耗更大体量的数据,在不丧失方法通用性的前提下,以高精度大规模重建三维场景,这是当代基于复杂模型的深度学习方法所无法实现的。具体而言,本论文介绍了三种新颖的方法,通过基于物理的建模来解决外观和几何推断的挑战。总体而言,本论文所涵盖的研究标志着在处理复杂数据集方面取得的一系列方法学上的胜利。通过融合深度学习、计算几何和摄影测量学,这项工作为快速发展的三维场景重建领域的未来探索和实际应用奠定了坚实的框架。这些研究的成果通过严格的实验以及与现有最先进方法的比较得到了证实,展示了所提出方法的有效性和可扩展性。

英文摘要:

3D scene modeling techniques serve as the bedrocks in the geospatial engineering and computer science, which drives many applications ranging from automated driving, terrain mapping, navigation, virtual, augmented, mixed, and extended reality (for gaming and movie industry etc.). This dissertation presents a fraction of contributions that advances 3D scene modeling to its state of the art, in the aspects of both appearance and geometry modeling. In contrast to the prevailing deep learning methods, as a core contribution, this thesis aims to develop algorithms that follow first principles, where sophisticated physic-based models are introduced alongside with simpler learning and inference tasks. The outcomes of these algorithms yield processes that can consume much larger volume of data for highly accurate reconstructing 3D scenes at a scale without losing methodological generality, which are not possible by contemporary complex-model based deep learning methods. Specifically, the dissertation introduces three novel methodologies that address the challenges of inferring appearance and geometry through physics-based modeling. Overall, the research encapsulated in this dissertation marks a series of methodological triumphs in the processing of complex datasets. By navigating the confluence of deep learning, computational geometry, and photogrammetry, this work lays down a robust framework for future exploration and practical application in the rapidly evolving field of 3D scene reconstruction. The outcomes of these studies are evidenced through rigorous experiments and comparisons with existing state-of-the-art methods, demonstrating the efficacy and scalability of the proposed approaches.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑