arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2502.16804cs.MAcs.AI
收藏

基于大语言模型的多智能体自动驾驶系统:近期进展综述

Multi-Agent Autonomous Driving Systems with Large Language Models: A Survey of Recent Advances

The University of Tokyo(东京大学);Cornell University(康奈尔大学);University of Illinois Chicago(伊利诺伊大学香槟分校)

Yaozu Wu, Dongyuan Li, Yankai Chen, Renhe Jiang, Henry Peng Zou, Wei-Chieh Huang, Yangning Li, Liancheng Fang, Zhen Wang, Philip S. Yu

AI总结:

本文综述了基于大语言模型的多智能体自动驾驶系统,通过语言驱动的通信与协调解决单智能体系统的感知、协作和计算挑战,并总结了方法分类、人机交互、应用、数据集及未来研究方向。

摘要:

自动驾驶系统(ADSs)通过减少人为干预、提高运行效率和增强安全性,正在彻底改变交通运输。大语言模型(LLMs)已被集成到自动驾驶系统中,凭借其强大的推理、指令遵循和通信能力,支持高层决策。然而,基于LLM的单智能体自动驾驶系统面临三大主要挑战:感知能力有限、协作不足以及计算需求高。为解决这些问题,基于LLM的多智能体自动驾驶系统的最新进展利用语言驱动的通信与协调来增强智能体间的协作。本文对这一自然语言处理与多智能体自动驾驶系统之间的新兴交叉领域进行了前沿综述。我们首先介绍相关概念的背景,随后基于不同的智能体交互模式对现有基于LLM的方法进行分类。接着,我们讨论在基于LLM的智能体与人类互动的场景中的人机交互。最后,我们总结了关键应用、数据集和挑战,以支持未来的研究。

英文摘要:

Autonomous Driving Systems (ADSs) are revolutionizing transportation by reducing human intervention, improving operational efficiency, and enhancing safety. Large Language Models (LLMs) have been integrated into ADSs to support high-level decision-making through their powerful reasoning, instruction-following, and communication abilities. However, LLM-based single-agent ADSs face three major challenges: limited perception, insufficient collaboration, and high computational demands. To address these issues, recent advances in LLM-based multi-agent ADSs leverage language-driven communication and coordination to enhance inter-agent collaboration. This paper provides a frontier survey of this emerging intersection between NLP and multi-agent ADSs. We begin with a background introduction to related concepts, followed by a categorization of existing LLM-based methods based on different agent interaction modes. We then discuss agent-human interactions in scenarios where LLM-based agents engage with humans. Finally, we summarize key applications, datasets, and challenges to support future research.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑