arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2405.04416cs.CV
收藏

DistGrid:使用分布式多分辨率哈希网格的可扩展场景重建

DistGrid: Scalable Scene Reconstruction with Distributed Multi-resolution Hash Grid

National University of Defence Technology(国防科技大学)

Sidun Liu, Peng Qiao, Zongxin Ye, Wenyu Li, Yong Dou

AI总结:

本文提出 DistGrid,通过分布式联合多分辨率哈希网格、非重叠轴对齐包围盒划分与分段体绘制消除背景 NeRF,实现高质量、可扩展的大规模场景重建。

摘要:

神经辐射场(Neural Radiance Field,NeRF)在物体尺度和室内场景重建中实现了极高的质量。然而,在重建大规模场景时仍存在一些挑战。基于 MLP 的 NeRF 受限于有限的网络容量,而基于体素的 NeRF 在场景分辨率提高时会消耗大量内存。近期方法提出对场景进行地理划分,并使用独立的 NeRF 学习每个子区域。此类划分策略有助于基于体素的 NeRF 突破单 GPU 内存限制,并扩展到更大的场景。然而,这种方法需要多个背景 NeRF 来处理超出划分区域的光线,从而导致学习冗余。受“当前划分区域的背景正是相邻划分区域的前景”这一事实启发,我们提出了一种基于联合多分辨率哈希网格的可扩展场景重建方法,名为 DistGrid。在该方法中,场景被划分为多个紧密铺设但互不重叠的轴对齐包围盒(Axis-Aligned Bounding Boxes),并提出了一种新颖的分段体绘制方法来处理跨边界光线,从而消除了对背景 NeRF 的需求。实验表明,我们的方法在所有评估的大规模场景上均优于现有方法,并提供了视觉上合理的场景重建。我们还从定性和定量角度进一步评估了该方法在重建质量方面的可扩展性。

英文摘要:

Neural Radiance Field~(NeRF) achieves extremely high quality in object-scaled and indoor scene reconstruction. However, there exist some challenges when reconstructing large-scale scenes. MLP-based NeRFs suffer from limited network capacity, while volume-based NeRFs are heavily memory-consuming when the scene resolution increases. Recent approaches propose to geographically partition the scene and learn each sub-region using an individual NeRF. Such partitioning strategies help volume-based NeRF exceed the single GPU memory limit and scale to larger scenes. However, this approach requires multiple background NeRF to handle out-of-partition rays, which leads to redundancy of learning. Inspired by the fact that the background of current partition is the foreground of adjacent partition, we propose a scalable scene reconstruction method based on joint Multi-resolution Hash Grids, named DistGrid. In this method, the scene is divided into multiple closely-paved yet non-overlapped Axis-Aligned Bounding Boxes, and a novel segmented volume rendering method is proposed to handle cross-boundary rays, thereby eliminating the need for background NeRFs. The experiments demonstrate that our method outperforms existing methods on all evaluated large-scale scenes, and provides visually plausible scene reconstruction. The scalability of our method on reconstruction quality is further evaluated qualitatively and quantitatively.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑