arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2407.10876cs.CV
收藏

RepVF:用于多任务3D感知的统一向量场表示

RepVF: A Unified Vector Fields Representation for Multi-task 3D Perception

School of Computer Science, Beijing Institute of Technology(北京理工大学计算机学院);University of Macau(澳门大学)

Chunliang Li, Wencheng Han, Junbo Yin, Sanyuan Zhao, Jianbing Shen

AI总结:

本文提出统一向量场表示RepVF及网络RFTR,通过单头多任务学习减少计算冗余和特征竞争,在OpenLane和Waymo数据集上验证了多任务3D感知的效率和有效性。

摘要:

在同一时空场景中并发处理多个自动驾驶3D感知任务是一项重大挑战,尤其是在使用传统的多任务学习方法时,由于任务之间的计算效率低下和特征竞争,这一问题尤为突出。本文通过提出一种新颖的统一表示方法RepVF来解决这些问题,该方法在单一框架内协调了诸如3D目标检测和3D车道检测等多种感知任务的表示。RepVF通过向量场来刻画场景中不同目标的结构,从而实现单头多任务学习模型,显著减少了计算冗余和特征竞争。基于RepVF,我们引入了RFTR,这是一种利用查询的层次结构来隐式建模任务间及任务内关系的网络,旨在挖掘不同任务之间的内在联系。该方法无需特定任务的头和参数,从根本上减少了传统多任务学习范式中固有的冲突。我们通过将OpenLane数据集中的标签与Waymo Open数据集相结合来验证我们的方法。我们的工作在自动驾驶多任务感知的效率和有效性方面取得了显著进展,为同步并行处理多个3D感知任务提供了新的视角。代码将在https://github.com/jbji/RepVF上提供。

英文摘要:

Concurrent processing of multiple autonomous driving 3D perception tasks within the same spatiotemporal scene poses a significant challenge, in particular due to the computational inefficiencies and feature competition between tasks when using traditional multi-task learning approaches. This paper addresses these issues by proposing a novel unified representation, RepVF, which harmonizes the representation of various perception tasks such as 3D object detection and 3D lane detection within a single framework. RepVF characterizes the structure of different targets in the scene through a vector field, enabling a single-head, multi-task learning model that significantly reduces computational redundancy and feature competition. Building upon RepVF, we introduce RFTR, a network designed to exploit the inherent connections between different tasks by utilizing a hierarchical structure of queries that implicitly model the relationships both between and within tasks. This approach eliminates the need for task-specific heads and parameters, fundamentally reducing the conflicts inherent in traditional multi-task learning paradigms. We validate our approach by combining labels from the OpenLane dataset with the Waymo Open dataset. Our work presents a significant advancement in the efficiency and effectiveness of multi-task perception in autonomous driving, offering a new perspective on handling multiple 3D perception tasks synchronously and in parallel. The code will be available at: https://github.com/jbji/RepVF

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑