arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2207.02201cs.CVcs.RO
收藏

基于时空信息融合的LiDAR-Based三维运动目标分割

Efficient Spatial-Temporal Information Fusion for LiDAR-Based 3D Moving Object Segmentation

Northwestern Polytechnical University(西北工业大学);HAOMO.AI Tech. Co., Ltd.(毫末智行科技有限公司)

Jiadai Sun, Yuchao Dai, Xianjing Zhang, Jintao Xu, Rui Ai, Weihao Gu, Xieyuanli Chen

摘要:

精确的运动目标分割是自动驾驶的一项重要任务。它可以为许多下游任务提供有效的信息,如避碰,路径规划和静态地图构建。如何有效地利用时空信息是三维激光雷达运动目标分割的关键问题。在这项工作中,我们提出了一种新的深度神经网络,利用时空信息和激光雷达扫描的不同表示方式来提高激光雷达MOS的性能。具体来说,我们首先使用基于距离图像的双分支结构来分别处理可以从连续激光雷达扫描中获得的空间和时间信息,然后使用运动引导注意力模块将它们结合起来。我们还通过3D稀疏卷积使用点细化模块来融合来自LiDAR范围图像和点云表示的信息,并减少对象边界上的伪影。我们验证了我们提出的方法的有效性的LiDAR-MOS基准SemanticKITTI。我们的方法在LiDAR-MOS IoU方面明显优于最先进的方法。受益于设计的粗到细的架构,我们的方法在传感器帧速率在线操作。我们的方法的实现可以在https://github.com/haomo-ai/MotionSeg3D上作为开源获得。

英文摘要:

Accurate moving object segmentation is an essential task for autonomous driving. It can provide effective information for many downstream tasks, such as collision avoidance, path planning, and static map construction. How to effectively exploit the spatial-temporal information is a critical question for 3D LiDAR moving object segmentation (LiDAR-MOS). In this work, we propose a novel deep neural network exploiting both spatial-temporal information and different representation modalities of LiDAR scans to improve LiDAR-MOS performance. Specifically, we first use a range image-based dual-branch structure to separately deal with spatial and temporal information that can be obtained from sequential LiDAR scans, and later combine them using motion-guided attention modules. We also use a point refinement module via 3D sparse convolution to fuse the information from both LiDAR range image and point cloud representations and reduce the artifacts on the borders of the objects. We verify the effectiveness of our proposed approach on the LiDAR-MOS benchmark of SemanticKITTI. Our method outperforms the state-of-the-art methods significantly in terms of LiDAR-MOS IoU. Benefiting from the devised coarse-to-fine architecture, our method operates online at sensor frame rate. The implementation of our method is available as open source at: https://github.com/haomo-ai/MotionSeg3D.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑