Recent works have considered two qualitatively different approaches to overcome line-of-sight limitations of 3D sensors used for perception: cooperative perception and infrastructure-augmented perception. In this paper, motivated by increasing deployments of infrastructure LiDARs, we explore a third approach, cooperative infrastructure perception. This approach generates perception outputs by fusing outputs of multiple infrastructure sensors, but, to be useful, must do so quickly and accurately. We describe the design, implementation and evaluation of Cooperative Infrastructure Perception (CIP), which uses a combination of novel algorithms and systems optimizations. It produces perception outputs within 100 ms using modest computing resources and with accuracy comparable to the state-of-the-art. CIP, when used to augment vehicle perception, can improve safety. When used in conjunction with offloaded planning, CIP can increase traffic throughput at intersections.
UrbanV2X: A Multisensory Vehicle-Infrastructure Dataset for Cooperative Navigation in Urban Areas
Department of Aeronautical and Aviation Engineering, The Hong Kong Polytechnic University(航空与航空工程系,香港理工大学);Hong Kong Applied Science and Technology Research Institute (ASTRI)(香港应用科学和技术研究院);Nanyang Technological University(南洋理工大学)
CoInfra: A Large-Scale Cooperative Infrastructure Perception System and Dataset for Vehicle-Infrastructure Cooperation in Adverse Weather
Department of Mechanical and Mechatronics Engineering, University of Waterloo(滑铁卢大学机械与机电工程系);Department of Mechanical Engineering, University of New Brunswick(新不伦瑞克大学机械工程系);Department of Data and Systems Engineering, University of Hong Kong(香港大学数据与系统工程系);Technology Partnerships and Innovations, Rogers Communications, Canada Inc.(罗杰斯通讯公司技术创新部);Department of Mechanical Engineering, University of Alberta(阿尔伯塔大学机械工程系)
Leveraging Temporal Contexts to Enhance Vehicle-Infrastructure Cooperative Perception
Shenzhen Automotive Research Institute, Beijing Institute of Technology(北京理工大学深圳汽车研究院);School of Mechanical Engineering, Beijing Institute of Technology(北京理工大学机械工程学院);Institute for AI Industry Research, Tsinghua University(清华大学人工智能产业研究院);School of Computer Science, The University of Hong Kong(香港大学计算机学院)
Nav-SCOPE: Swarm Robot Cooperative Perception and Coordinated Navigation
Department of Automation, Tsinghua University(自动化系,清华大学);Beijing National Research Center for Information Science and Technology, Tsinghua University(北京信息科学与技术国家研究中心,清华大学);School of Mechanical and Electrical Engineering, Beijing Information Science and Technology University(机械与电子工程学院,北京信息科学与技术大学)
Interruption-Aware Cooperative Perception for V2X Communication-Aided Autonomous Driving
Cooperative Medianet Innovation Center, Shanghai Jiao Tong University(上海交通大学合作 Medianet 创新中心);Shanghai AI Laboratory(上海人工智能实验室);The University of Warwick(华威大学)
SAP-CoPE: Social-Aware Planning using Cooperative Pose Estimation with Infrastructure Sensor Nodes
Mechanical and Mechatronics Eng. Department, University of Waterloo(机械与机电工程系,滑铁库大学);Department of Data and Systems Engineering, University of Hong Kong(数据与系统工程系,香港大学);Mechanical Engineering Department, University of Alberta(机械工程系,阿尔伯塔大学)
CooperRisk: A Driving Risk Quantification Pipeline with Multi-Agent Cooperative Perception and Prediction
UCLA Mobility Lab, University of California, Los Angeles, USA(加州大学洛杉矶分校移动实验室);Key Laboratory of Road and Traffic Engineering of the Ministry of Education, Tongji University, Shanghai, China(教育部道路与交通工程重点实验室)
RCooper: A Real-world Large-scale Dataset for Roadside Cooperative Perception
Institute for AI Industry Research (AIR), Tsinghua University(清华大学人工智能产业研究院(AIR));China Automotive Innovation Corporation(中国汽车创新公司);The University of Hong Kong(香港大学)
MMUSV-Sim: A Maritime Simulation Platform for Multi-USV Cooperative Perception
School of Intelligent Systems Engineering, Sun Yat-sen University(中山大学智能工程学院);School of Intelligent Imagery Engineering, Beijing Film Academy(北京电影学院智能影像工程学院)
V2X-QA: A Comprehensive Reasoning Dataset and Benchmark for Multimodal Large Language Models in Autonomous Driving Across Ego, Infrastructure, and Cooperative Views
Department of Civil and Environmental Engineering, University of Wisconsin–Madison(威斯康星大学麦迪逊分校土木与环境工程系);Department of Civil and Architectural Engineering and Construction Management, University of Wyoming(怀俄明大学土木与建筑工程及施工管理系);School of Transportation, Southeast University(东南大学交通学院)
Real-time Vehicle-to-Vehicle Communication Based Network Cooperative Control System through Distributed Database and Multimodal Perception: Demonstrated in Crossroads
Zhejiang University(浙江大学);University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);University of Michigan(密歇根大学)
Hyper-V2X: Hypernetworks for Estimating Epistemic and Aleatoric Uncertainty in Cooperative Bird's-Eye-View Semantic Segmentation
CARISSMA Institute for Electric, COnnected, and Secure Mobility (C-ECOS), Technische Hochschule Ingolstadt(CARISSMA电动、连接与安全移动研究所(C-ECOS)、因戈尔施塔特技术大学);University of Applied Sciences Aschaffenburg(阿施发堡应用科学大学)
CMP: Cooperative Motion Prediction with Multi-Agent Communication
University of California, Riverside(加利福尼亚大学河滨分校);University of Michigan(密歇根大学);University of California, Berkeley(加利福尼亚大学伯克利分校);University of Washington(华盛顿大学)