arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2507.18331cs.CV
收藏

通过自适应3D体构建增强多视图室内3D目标检测

Boosting Multi-View Indoor 3D Object Detection via Adaptive 3D Volume Construction

College of Information Science and Electronic Engineering, Zhejiang University(浙江大学信息科学与电子工程学院);Ningbo Global Innovation Center, Zhejiang University(浙江大学宁波全球创新中心);NingboTech University(宁波科技学院);City University of Hong Kong(香港城市大学)

Runmin Zhang, Zhu Yu, Si-Yuan Cao, Lingyu Zhu, Guangyi Zhang, Xiaokai Bai, Hui-Liang Shen

AI总结:

提出SGCDet多视图室内3D检测框架,通过几何上下文感知聚合与稀疏自适应3D体构建提升特征表示和效率,仅需3D框监督,并在三个数据集上达到SOTA。

摘要:

本工作提出了SGCDet,这是一种基于自适应3D体构建的新型多视图室内3D目标检测框架。不同于以往将体素感受野限制在图像上固定位置的方法,我们引入了一个几何与上下文感知聚合模块,用于在每张图像的自适应区域内整合几何信息和上下文信息,并动态调整来自不同视图的贡献,从而增强体素特征的表示能力。此外,我们提出了一种稀疏体构建策略,该策略自适应地识别并选择具有高占据概率的体素进行特征细化,从而最大限度地减少自由空间中的冗余计算。得益于上述设计,我们的框架以自适应方式实现了有效且高效的体构建。更优的是,我们的网络仅需使用3D边界框即可进行监督,消除了对真实场景几何的依赖。实验结果表明,SGCDet在ScanNet、ScanNet200和ARKitScenes数据集上取得了最先进的性能。源代码可在https://github.com/RM-Zhang/SGCDet获取。

英文摘要:

This work presents SGCDet, a novel multi-view indoor 3D object detection framework based on adaptive 3D volume construction. Unlike previous approaches that restrict the receptive field of voxels to fixed locations on images, we introduce a geometry and context aware aggregation module to integrate geometric and contextual information within adaptive regions in each image and dynamically adjust the contributions from different views, enhancing the representation capability of voxel features. Furthermore, we propose a sparse volume construction strategy that adaptively identifies and selects voxels with high occupancy probabilities for feature refinement, minimizing redundant computation in free space. Benefiting from the above designs, our framework achieves effective and efficient volume construction in an adaptive way. Better still, our network can be supervised using only 3D bounding boxes, eliminating the dependence on ground-truth scene geometry. Experimental results demonstrate that SGCDet achieves state-of-the-art performance on the ScanNet, ScanNet200 and ARKitScenes datasets. The source code is available at https://github.com/RM-Zhang/SGCDet.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑