arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2407.19280cs.AIcs.RO
收藏

用于类人自动驾驶的大型语言模型:综述

Large Language Models for Human-like Autonomous Driving: A Survey

The University of Tokyo(东京大学)

Yun Li, Kai Katsumata, Ehsan Javanmardi, Manabu Tsukada

AI总结:

本综述全面回顾了大型语言模型在自动驾驶中的应用,涵盖模块化管道与端到端系统,分析了关键进展、实时推理与安全等挑战,并提出未来研究方向,旨在推动更安全智能的类人自动驾驶技术发展。

摘要:

大型语言模型(LLMs)是在海量文本语料库上训练的AI模型,具有卓越的语言理解和生成能力,正在改变自动驾驶(AD)领域。随着AD系统从基于规则和优化的方法演进为深度强化学习等基于学习的技术,它们现在正准备迎接第三个更先进的类别:由LLMs赋能的基于知识的AD。这一转变有望使AD更接近类人AD。然而,将LLMs集成到AD系统中在实时推理、安全保障和部署成本方面带来了挑战。本综述对利用LLMs进行AD的最新进展进行了全面而批判性的回顾,重点关注它们在模块化AD管道和端到端AD系统中的应用。我们强调了关键进展,识别了紧迫的挑战,并提出了有前景的研究方向,以弥合LLMs与AD之间的差距,从而促进更类人的AD系统的开发。综述首先介绍了LLMs的关键特性和常见训练方案,然后分别深入探讨了它们在模块化AD管道和端到端AD中的应用,随后讨论了开放挑战和未来方向。通过这一深入分析,我们旨在为在AI和自动驾驶汽车交叉领域工作的研究人员和从业者提供见解和启发,最终为更安全、更智能和更以人为中心的AD技术做出贡献。

英文摘要:

Large Language Models (LLMs), AI models trained on massive text corpora with remarkable language understanding and generation capabilities, are transforming the field of Autonomous Driving (AD). As AD systems evolve from rule-based and optimization-based methods to learning-based techniques like deep reinforcement learning, they are now poised to embrace a third and more advanced category: knowledge-based AD empowered by LLMs. This shift promises to bring AD closer to human-like AD. However, integrating LLMs into AD systems poses challenges in real-time inference, safety assurance, and deployment costs. This survey provides a comprehensive and critical review of recent progress in leveraging LLMs for AD, focusing on their applications in modular AD pipelines and end-to-end AD systems. We highlight key advancements, identify pressing challenges, and propose promising research directions to bridge the gap between LLMs and AD, thereby facilitating the development of more human-like AD systems. The survey first introduces LLMs' key features and common training schemes, then delves into their applications in modular AD pipelines and end-to-end AD, respectively, followed by discussions on open challenges and future directions. Through this in-depth analysis, we aim to provide insights and inspiration for researchers and practitioners working at the intersection of AI and autonomous vehicles, ultimately contributing to safer, smarter, and more human-centric AD technologies.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑