In recent years, large language models have had a very impressive performance, which largely contributed to the development and application of artificial intelligence, and the parameters and performance of the models are still growing rapidly. In particular, multimodal large language models (MLLM) can combine multiple modalities such as pictures, videos, sounds, texts, etc., and have great potential in various tasks. However, most MLLMs require very high computational resources, which is a major challenge for most researchers and developers. In this paper, we explored the utility of small-scale MLLMs and applied small-scale MLLMs to the field of autonomous driving. We hope that this will advance the application of MLLMs in real-world scenarios.
Meta-Learning Online Dynamics Model Adaptation in Off-Road Autonomous Driving
Jet Propulsion Laboratory, California Institute of Technology(喷气推进实验室、加州理工学院);University of Texas at Austin(德克萨斯大学奥斯汀分校);Georgia Institute of Technology(佐治亚理工学院)
Emerging Threats in Deep Learning-Based Autonomous Driving: A Comprehensive Survey
Hubei University(湖北大学)
自2004年DARPA Grand Challenge以来,自动驾驶技术已经经历了近二十年的快速发展。特别是近年来,随着新型传感器和深度学习技术的应用向自动驾驶领域延伸,自动驾驶技术的发展不断取得突破。因此,许多汽车制造商和高科技巨头致力于自动驾驶的研究和系统开发。然而,作为自动驾驶的基础,深度学习技术面临着许多新的安全风险。学术界针对对抗性示例和AI后门提出了深度学习对策,并将其引入自动驾驶领域进行验证。深度学习安全关系到自动驾驶系统的安全,进而关系到人身安全,是一个值得关注和研究的问题,本文综述了自动驾驶中深度学习安全技术的概念、发展和最新研究。首先,我们简要介绍了自动驾驶系统中的深度学习框架和流水线,主要包括该领域常用的深度学习技术和算法。此外,我们还重点分析了基于深度学习的自动驾驶系统在各个功能层中的潜在安全威胁。本文回顾了自动驾驶领域深度学习攻击技术的发展历程,分析了当前自动驾驶领域的最新算法,揭示了其潜在的风险。最后,我们对自动驾驶领域的深度学习安全性进行了展望,并为构建安全可信的自动驾驶系统提出了建议。
Attack End-to-End Autonomous Driving through Module-Wise Noise
School of Computer Science and Engineering, Beihang University(北京航空航天大学计算机科学与工程学院);State Key Lab of Software Development Environment, Beihang University(北京航空航天大学软件开发环境国家重点实验室);Shen Yuan Honors College, Beihang University(北京航空航天大学沈元荣誉学院);School of Software, Beihang University(北京航空航天大学软件学院)
Deep Neural Network Perception Models and Robust Autonomous Driving Systems
Waterloo Artificial Intelligence Institute(滑铁卢人工智能研究所);Department of Systems Design Engineering, University of Waterloo(滑铁卢大学系统设计工程系);David Cheriton school of Computer science, University of Waterloo(滑铁卢大学戴维·谢里顿计算机学院);University of Waterloo(滑铁卢大学)
Machine Learning-Based Vehicle Intention Trajectory Recognition and Prediction for Autonomous Driving
University of Southern California(南加州大学);Virginia Tech(弗吉尼亚理工大学);Miami University(迈阿密大学);Northern Arizona University(北亚利桑那大学);Northeastern University(东北大学)
Motion Comfort Optimization for Autonomous Vehicles: Concepts, Methods, and Techniques
University of North Texas(北德克萨斯大学);Fordham University(福特汉姆大学);Qatar University(卡塔尔大学);University of Nebraska at Kearney(内布拉斯加大学卡尼尔分校);Mohamed Bin Zayed University of Artificial Intelligence (MBZUAI)(穆罕默德·本·扎耶德人工智能大学(MBZUAI));Hamad Bin Khalifa University(哈马德·本·哈利法大学)
World Models for Autonomous Driving: An Initial Survey
University of Macau(澳门大学);College of Transportation Engineering, Tongji University(同济大学交通运输工程学院);Tsinghua University(清华大学);Macau University of Science and Technology(澳门科技大学);University of Hawaii at Manoa(夏威夷大学马诺阿分校)
Enabling Level-4 Autonomous Driving on a Single $1k Off-the-Shelf Card
Perceptin LLC(Perceptin有限责任公司);Northeastern Univ(东北大学);COCOPLE LLC(COCOPLE有限责任公司);College of William and Mary(威廉玛丽学院);North Carolina State University(北卡罗来纳州立大学)