The progress in autonomous driving is also due to the increased availability of vast amounts of training data for the underlying machine learning approaches. Machine learning systems are generally known to lack robustness, e.g., if the training data did rarely or not at all cover critical situations. The challenging task of corner case detection in video, which is also somehow related to unusual event or anomaly detection, aims at detecting these unusual situations, which could become critical, and to communicate this to the autonomous driving system (online use case). Such a system, however, could be also used in offline mode to screen vast amounts of data and select only the relevant situations for storing and (re)training machine learning algorithms. So far, the approaches for corner case detection have been limited to videos recorded from a fixed camera, mostly for security surveillance. In this paper, we provide a formal definition of a corner case and propose a system framework for both the online and the offline use case that can handle video signals from front cameras of a naturally moving vehicle and can output a corner case score.
JiSAM: Alleviate Labeling Burden and Corner Case Problems in Autonomous Driving via Minimal Real-World Data
The University of Hong Kong(香港大学);Shanghai AI Laboratory(上海人工智能实验室);Voyager Research, Didi Chuxing(滴滴出行 Voyager 研究);The Chinese University of Hong Kong (Shenzhen)(香港中文大学(深圳));HKU Shanghai Intelligent Computing Research Center(香港大学上海智能计算研究中心)
CODA: A Real-World Road Corner Case Dataset for Object Detection in Autonomous Driving
Huawei Noah’s Ark Lab(华为诺亚方舟实验室);Hong Kong University of Science and Technology(香港科技大学);Huawei Intelligent Automotive Solution BU(华为智能汽车解决方案BU);Sun Yat-sen University(中山大学)
Autonomous Driving with Deep Learning: A Survey of State-of-Art Technologies
Black Sesame Technology Inc.(黑芝麻智能科技有限公司);Futurewei Technology Inc.(星网锐捷技术有限公司)
自2004/05年DARPA Grand Challenges(农村)和2007年Urban Challenges以来,自动驾驶一直是人工智能应用最活跃的领域。几乎同时,深度学习也有几位先驱者取得了突破,其中Hinton、Bengio和LeCun三位(也被称为深度学习之父)在2019年获得了ACM都灵奖。这是一个关于自动驾驶技术与深度学习方法的调查。我们研究了自动驾驶系统的主要领域,如感知,地图和定位,预测,规划和控制,仿真,V2X和安全等。由于篇幅有限,我们重点分析了几个关键领域,即感知中的2D和3D目标检测,摄像机的深度估计,数据,特征和任务层面的多传感器融合,车辆驾驶和行人轨迹的行为建模和预测。
ECCV 2024 W-CODA: 1st Workshop on Multimodal Perception and Comprehension of Corner Cases in Autonomous Driving
Hong Kong University of Science and Technology(香港科学与技术大学);The Chinese University of Hong Kong(香港中文大学);Dalian University of Technology(大连理工大学);TU Delft(代尔夫特理工大学);Huawei Noah’s Ark Lab(华为诺亚实验室);Huawei Zurich Research Center(华为苏黎世研究中心);Huawei IAS BU(华为IAS业务单元)
Addressing Corner Cases in Autonomous Driving: A World Model-based Approach with Mixture of Experts and LLMs
State Key Laboratory of Internet of Things for Smart City, University of Macau(物联网智能城市国家重点实验室,澳门大学);Department of Computer and Information Science, University of Macau(计算机与信息科学系,澳门大学);Department of Civil and Environmental Engineering, University of Macau(土木与环境工程系,澳门大学);Senseable City Lab, Massachusetts Institute of Technology(可感知城市实验室,麻省理工学院);Department of Civil and Environmental Engineering, University of Hawaii(土木与环境工程系,夏威夷大学)
A Framework for a Capability-driven Evaluation of Scenario Understanding for Multimodal Large Language Models in Autonomous Driving
Dr. Ing. h.c. F. Porsche AG(保时捷股份公司);Forschungszentrum Informatik(弗劳恩霍夫信息技术研究中心);Hochschule Esslingen(埃斯林根应用技术大学);University of Michigan(密歇根大学);Voxel51;Karlsruher Institut für Technologie(卡尔斯鲁厄理工学院)
Deep Neural Network Perception Models and Robust Autonomous Driving Systems
Waterloo Artificial Intelligence Institute(滑铁卢人工智能研究所);Department of Systems Design Engineering, University of Waterloo(滑铁卢大学系统设计工程系);David Cheriton school of Computer science, University of Waterloo(滑铁卢大学戴维·谢里顿计算机学院);University of Waterloo(滑铁卢大学)
Machine Learning-Based Vehicle Intention Trajectory Recognition and Prediction for Autonomous Driving
University of Southern California(南加州大学);Virginia Tech(弗吉尼亚理工大学);Miami University(迈阿密大学);Northern Arizona University(北亚利桑那大学);Northeastern University(东北大学)
Motion Comfort Optimization for Autonomous Vehicles: Concepts, Methods, and Techniques
University of North Texas(北德克萨斯大学);Fordham University(福特汉姆大学);Qatar University(卡塔尔大学);University of Nebraska at Kearney(内布拉斯加大学卡尼尔分校);Mohamed Bin Zayed University of Artificial Intelligence (MBZUAI)(穆罕默德·本·扎耶德人工智能大学(MBZUAI));Hamad Bin Khalifa University(哈马德·本·哈利法大学)
Shanghai Artificial Intelligence Laboratory(上海人工智能实验室);East China Normal University(华东师范大学);Chinese University of Hong Kong(香港中文大学);Zhejiang University(浙江大学)
Automated Evaluation of Large Vision-Language Models on Self-driving Corner Cases
Hong Kong University of Science and Technology(香港科技大学);Dalian University of Technology(大连理工大学);The Chinese University of Hong Kong(香港中文大学);Huawei Noah’s Ark Lab(华为诺亚方舟实验室)