arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2310.05366cs.CV

Rotation Matters: 面向多种相机系统的泛化单目3D目标检测

Rotation Matters: Generalized Monocular 3D Object Detection for Various Camera Systems

DGIST(大邱庆北科学技术院)

SungHo Moon, JinWoo Bae, SungHoon Im

AI总结:

针对单目3D目标检测跨相机系统性能下降的问题,本文发现相机朝向变化是关键因素,提出可即插即用的补偿模块校正3D框位置与朝向,无需额外训练即可大幅提升跨系统检测性能。

摘要:

单目3D目标检测研究正受到广泛关注,其性能也在稳步提升。然而,当将3D目标检测方法应用于与训练数据集采集所用相机系统不同的系统时,检测性能会大幅下降。例如,在乘用车采集的数据集上训练的3D检测器,大多无法为安装在公交车上的相机回归出准确的3D边界框。本文开展了大量实验,分析导致性能下降的因素。我们发现,相机相对于路面的位姿变化,尤其是相机朝向的变化,是造成性能下降的原因。此外,我们提出了一种可通用应用于多种相机系统的泛化3D目标检测方法。我们全新设计了一个补偿模块,用于校正估计得到的3D边界框的位置和朝向。该模块可应用于大多数最新的3D目标检测网络,在无需额外训练的情况下,其AP3D得分(KITTI中等难度,IoU > 70%)相比基线提升约6到10倍。定量和定性结果均验证了所提方法的有效性。

英文摘要:

Research on monocular 3D object detection is being actively studied, and as a result, performance has been steadily improving. However, 3D object detection performance is significantly reduced when applied to a camera system different from the system used to capture the training datasets. For example, a 3D detector trained on datasets from a passenger car mostly fails to regress accurate 3D bounding boxes for a camera mounted on a bus. In this paper, we conduct extensive experiments to analyze the factors that cause performance degradation. We find that changing the camera pose, especially camera orientation, relative to the road plane caused performance degradation. In addition, we propose a generalized 3D object detection method that can be universally applied to various camera systems. We newly design a compensation module that corrects the estimated 3D bounding box location and heading direction. The proposed module can be applied to most of the recent 3D object detection networks. It increases AP3D score (KITTI moderate, IoU $> 70\%$) about 6-to-10-times above the baselines without additional training. Both quantitative and qualitative results show the effectiveness of the proposed method.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑