arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2312.04484cs.CVcs.RO
收藏

FRNet: 面向可扩展激光雷达分割的视锥-距离网络

FRNet: Frustum-Range Networks for Scalable LiDAR Segmentation

College of Computer Science and Technology, Nanjing University of Aeronautics and Astronautics(南京航空航天大学计算机科学与技术学院);School of Computer Science, Nanjing University of Posts and Telecommunications(南京邮电大学计算机学院)

Xiang Xu, Lingdong Kong, Hui Shuai, Qingshan Liu

AI总结:

针对距离视图激光雷达分割存在上下文信息受损、依赖后处理的问题,提出FRNet通过视锥特征编码、分层融合等模块恢复上下文信息,在多个基准上取得优异性能且速度达SOTA的5倍,提升了分割可扩展性。

摘要:

激光雷达分割已成为先进自动驾驶系统的关键组成部分。近期的距离视图激光雷达分割方法在实时处理方面展现出潜力,但它们不可避免地存在上下文信息受损的问题,且严重依赖后处理技术来优化预测结果。本文提出FRNet,这是一种简单却强大的方法,旨在利用对应的视锥激光雷达点恢复距离图像像素的上下文信息。首先,采用视锥特征编码器模块提取视锥区域内的逐点特征,该模块能保持场景一致性,这对点级预测至关重要。接着,引入视锥-点融合模块分层更新逐点特征,使每个点都能通过视锥特征提取更多周围信息。最后,使用头部融合模块融合不同层级的特征以生成最终的语义预测结果。我们在四种主流激光雷达分割基准上、多种任务设置下开展了大量实验,结果证明了FRNet的优越性。值得注意的是,FRNet在SemanticKITTI和nuScenes的测试集上分别取得了73.3%和82.5%的mIoU分数。在实现极具竞争力性能的同时,FRNet的运行速度是现有最优方法的5倍。如此高的效率为更具可扩展性的激光雷达分割开辟了新的可能。代码已公开发布于https://github.com/Xiangxu-0103/FRNet。

英文摘要:

LiDAR segmentation has become a crucial component of advanced autonomous driving systems. Recent range-view LiDAR segmentation approaches show promise for real-time processing. However, they inevitably suffer from corrupted contextual information and rely heavily on post-processing techniques for prediction refinement. In this work, we propose FRNet, a simple yet powerful method aimed at restoring the contextual information of range image pixels using corresponding frustum LiDAR points. First, a frustum feature encoder module is used to extract per-point features within the frustum region, which preserves scene consistency and is critical for point-level predictions. Next, a frustum-point fusion module is introduced to update per-point features hierarchically, enabling each point to extract more surrounding information through the frustum features. Finally, a head fusion module is used to fuse features at different levels for final semantic predictions. Extensive experiments conducted on four popular LiDAR segmentation benchmarks under various task setups demonstrate the superiority of FRNet. Notably, FRNet achieves 73.3% and 82.5% mIoU scores on the testing sets of SemanticKITTI and nuScenes. While achieving competitive performance, FRNet operates 5 times faster than state-of-the-art approaches. Such high efficiency opens up new possibilities for more scalable LiDAR segmentation. The code has been made publicly available at https://github.com/Xiangxu-0103/FRNet.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑