arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2312.04372cs.CLcs.AI
收藏

LaMPilot:一个使用语言模型程序实现自动驾驶的开放基准数据集

LaMPilot: An Open Benchmark Dataset for Autonomous Driving with Language Model Programs

Purdue University(普渡大学);University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);University of Virginia(弗吉尼亚大学);InfoTech Labs, Toyota Motor North America(丰田北美信息技术实验室)

Yunsheng Ma, Can Cui, Xu Cao, Wenqian Ye, Peiran Liu, Juanwu Lu, Amr Abdelraouf, Rohit Gupta, Kyungtae Han, Aniket Bera, James M. Rehg, Ziran Wang

AI总结:

本文提出 LaMPilot 框架与 LaMPilot-Bench 基准,通过让 LLM 生成调用功能原语的代码,评估其在自动驾驶中理解并执行自然语言指令的能力。

摘要:

近年来,自动驾驶(AD)取得了显著进展。然而,现有框架在理解和执行诸如“超过前面的车”之类的自发用户指令方面仍存在困难。大型语言模型(LLM)已展现出令人瞩目的推理能力,显示出弥合这一差距的潜力。本文提出 LaMPilot,这是一种将 LLM 集成到 AD 系统中的新颖框架,使系统能够通过生成利用既有功能原语的代码来遵循用户指令。我们还推出了 LaMPilot-Bench,这是首个专门用于定量评估 AD 中语言模型程序有效性的基准数据集。采用 LaMPilot 框架后,我们开展了大量实验,以评估现成 LLM 在 LaMPilot-Bench 上的性能。结果证明了 LLM 在处理多样驾驶场景并在驾驶中遵循用户指令方面的潜力。为促进该领域的进一步研究,我们在 https://github.com/PurdueDigitalTwin/LaMPilot 发布了代码和数据。

英文摘要:

Autonomous driving (AD) has made significant strides in recent years. However, existing frameworks struggle to interpret and execute spontaneous user instructions, such as "overtake the car ahead." Large Language Models (LLMs) have demonstrated impressive reasoning capabilities showing potential to bridge this gap. In this paper, we present LaMPilot, a novel framework that integrates LLMs into AD systems, enabling them to follow user instructions by generating code that leverages established functional primitives. We also introduce LaMPilot-Bench, the first benchmark dataset specifically designed to quantitatively evaluate the efficacy of language model programs in AD. Adopting the LaMPilot framework, we conduct extensive experiments to assess the performance of off-the-shelf LLMs on LaMPilot-Bench. Our results demonstrate the potential of LLMs in handling diverse driving scenarios and following user instructions in driving. To facilitate further research in this area, we release our code and data at https://github.com/PurdueDigitalTwin/LaMPilot.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑