arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2405.14014cs.CVcs.AIcs.LGcs.RO
收藏

RadarOcc:基于4D成像雷达的鲁棒3D占用预测

RadarOcc: Robust 3D Occupancy Prediction with 4D Imaging Radar

University of Edinburgh(爱丁堡大学);Georgia Institute of Technology(佐治亚理工学院);New York University(纽约大学);UCL(伦敦大学学院);AI Centre(人工智能中心)

Fangqiang Ding, Xiangyu Wen, Yunzhou Zhu, Yiming Li, Chris Xiaoxuan Lu

AI总结:

本文提出RadarOcc,直接处理4D成像雷达张量并结合多普勒、稀疏化、注意力与球坐标编码实现鲁棒3D占用预测,在K-Radar上达到先进水平。

摘要:

基于3D占用的感知流程通过捕捉精细的场景描述,并在各种物体类别和形状上展现出较强的泛化能力,显著推动了自动驾驶的发展。当前方法主要依赖LiDAR或相机输入进行3D占用预测。这些方法容易受到恶劣天气条件的影响,从而限制了自动驾驶汽车的全天候部署。为提升感知鲁棒性,我们利用车载雷达的最新进展,提出一种使用4D成像雷达传感器进行3D占用预测的新方法。我们的方法RadarOcc通过直接处理4D雷达张量来规避稀疏雷达点云的局限,从而保留关键的场景细节。RadarOcc采用Doppler bins描述符、旁瓣感知空间稀疏化以及按距离自注意力机制,创新性地应对海量且含噪的4D雷达数据所带来的挑战。为最大限度减少直接坐标变换相关的插值误差,我们还设计了基于球面的特征编码,随后进行球面到笛卡尔坐标的特征聚合。我们在公开的K-Radar数据集上对基于不同模态的多种基线方法进行了基准测试。结果表明,RadarOcc在基于雷达的3D占用预测中取得了最先进性能,即使与基于LiDAR或相机的方法相比也展现出可观结果。此外,我们给出了4D雷达在恶劣天气条件下优越性能的定性证据,并通过消融研究探讨了关键流程组件的影响。

英文摘要:

3D occupancy-based perception pipeline has significantly advanced autonomous driving by capturing detailed scene descriptions and demonstrating strong generalizability across various object categories and shapes. Current methods predominantly rely on LiDAR or camera inputs for 3D occupancy prediction. These methods are susceptible to adverse weather conditions, limiting the all-weather deployment of self-driving cars. To improve perception robustness, we leverage the recent advances in automotive radars and introduce a novel approach that utilizes 4D imaging radar sensors for 3D occupancy prediction. Our method, RadarOcc, circumvents the limitations of sparse radar point clouds by directly processing the 4D radar tensor, thus preserving essential scene details. RadarOcc innovatively addresses the challenges associated with the voluminous and noisy 4D radar data by employing Doppler bins descriptors, sidelobe-aware spatial sparsification, and range-wise self-attention mechanisms. To minimize the interpolation errors associated with direct coordinate transformations, we also devise a spherical-based feature encoding followed by spherical-to-Cartesian feature aggregation. We benchmark various baseline methods based on distinct modalities on the public K-Radar dataset. The results demonstrate RadarOcc's state-of-the-art performance in radar-based 3D occupancy prediction and promising results even when compared with LiDAR- or camera-based methods. Additionally, we present qualitative evidence of the superior performance of 4D radar in adverse weather conditions and explore the impact of key pipeline components through ablation studies.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑