arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1902.07830cs.RO
收藏

自动驾驶的深度多模态目标检测和语义分割:数据集、方法和挑战

Deep Multi-modal Object Detection and Semantic Segmentation for Autonomous Driving: Datasets, Methods, and Challenges

Robert Bosch GmbH(罗伯特博世有限公司);Ulm University(乌尔姆大学);Karlsruhe Institute of Technology(卡尔斯鲁厄理工学院)

Di Feng, Christian Haase-Schütz, Lars Rosenbaum, Heinz Hertlein, Claudius Glaeser, Fabian Timm, Werner Wiesbeck, Klaus Dietmayer

摘要:

自动驾驶感知的最新进展是由深度学习驱动的。为了实现鲁棒且准确的场景理解,自动驾驶车辆通常配备有不同的传感器(例如相机、LiDAR、雷达),并且可以融合多种感测模态以利用它们的互补特性。在这种背景下,已经提出了许多方法用于深度多模态感知问题。然而,目前还没有一个通用的网络架构设计的指导方针,和“什么融合”,“何时融合”,以及“如何融合”的问题仍然悬而未决。本文试图系统地总结自动驾驶中深度多模态目标检测和语义分割的方法并讨论其面临的挑战。为此,我们首先概述了测试车辆上的车载传感器、开放数据集以及自动驾驶研究中用于目标检测和语义分割的背景信息。然后,我们总结了融合方法,并讨论了挑战和开放的问题。在附录中,我们提供了总结主题和方法的表格。我们还提供了一个互动的在线平台来浏览每个参考:https://boschresearch.github.io/multimodalperception/。

英文摘要:

Recent advancements in perception for autonomous driving are driven by deep learning. In order to achieve robust and accurate scene understanding, autonomous vehicles are usually equipped with different sensors (e.g. cameras, LiDARs, Radars), and multiple sensing modalities can be fused to exploit their complementary properties. In this context, many methods have been proposed for deep multi-modal perception problems. However, there is no general guideline for network architecture design, and questions of "what to fuse", "when to fuse", and "how to fuse" remain open. This review paper attempts to systematically summarize methodologies and discuss challenges for deep multi-modal object detection and semantic segmentation in autonomous driving. To this end, we first provide an overview of on-board sensors on test vehicles, open datasets, and background information for object detection and semantic segmentation in autonomous driving research. We then summarize the fusion methodologies and discuss challenges and open questions. In the appendix, we provide tables that summarize topics and methods. We also provide an interactive online platform to navigate each reference: https://boschresearch.github.io/multimodalperception/.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑