多智能体多次遍历多模态自动驾驶:开放 MARS 数据集
Multiagent Multitraversal Multimodal Self-Driving: Open MARS Dataset
AI总结:
本文联合 May Mobility 发布 MARS 数据集,通过自动驾驶车队采集多智能体、多次遍历与多模态数据,支撑协同驾驶、记忆回顾及 3D 重建等研究。
摘要:
大规模数据集推动了近期基于 AI 的自动驾驶汽车研究进展。然而,这些数据集通常采集自单一车辆对某一地点的一次性经过,缺乏多智能体交互或对同一地点的重复遍历。这类信息可能为自动驾驶汽车的感知、预测和规划能力带来变革性提升。为弥合这一差距,我们与自动驾驶公司 May Mobility 合作,提出了 MARS 数据集,该数据集统一了支持 MultiAgent(多智能体)、multitraveRSal(多次遍历)和多模态自动驾驶汽车研究的场景。更具体地说,MARS 是由在特定地理区域内行驶的自动驾驶汽车车队采集的。每辆车都有自己的路线,不同车辆可能出现在附近位置。每辆车均配备一个 LiDAR 和环视 RGB 相机。我们在 MARS 中整理了两个子集:一个子集支持多辆车同时出现在同一地点的协同驾驶,另一个子集通过多辆车对同一地点的异步遍历实现记忆回顾。我们在地点识别和神经重建方面开展了实验。更重要的是,MARS 引入了新的研究机遇与挑战,例如多次遍历 3D 重建、多智能体感知和无监督物体发现。我们的数据和代码可在 https://ai4ce.github.io/MARS/ 获取。
英文摘要:
Large-scale datasets have fueled recent advancements in AI-based autonomous vehicle research. However, these datasets are usually collected from a single vehicle's one-time pass of a certain location, lacking multiagent interactions or repeated traversals of the same place. Such information could lead to transformative enhancements in autonomous vehicles' perception, prediction, and planning capabilities. To bridge this gap, in collaboration with the self-driving company May Mobility, we present the MARS dataset which unifies scenarios that enable MultiAgent, multitraveRSal, and multimodal autonomous vehicle research. More specifically, MARS is collected with a fleet of autonomous vehicles driving within a certain geographical area. Each vehicle has its own route and different vehicles may appear at nearby locations. Each vehicle is equipped with a LiDAR and surround-view RGB cameras. We curate two subsets in MARS: one facilitates collaborative driving with multiple vehicles simultaneously present at the same location, and the other enables memory retrospection through asynchronous traversals of the same location by multiple vehicles. We conduct experiments in place recognition and neural reconstruction. More importantly, MARS introduces new research opportunities and challenges such as multitraversal 3D reconstruction, multiagent perception, and unsupervised object discovery. Our data and codes can be found at https://ai4ce.github.io/MARS/.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。