LimSim++: 用于在自动驾驶中部署多模态大语言模型的闭环平台
LimSim++: A Closed-Loop Platform for Deploying Multimodal LLMs in Autonomous Driving
AI总结:
针对现有自动驾驶仿真平台的不足,研究团队推出LimSim++闭环仿真平台,支持多模态大语言模型的长周期多场景仿真、评估与优化,还提供基线框架并经定量实验验证,已开源。
摘要:
多模态大语言模型((M)LLMs)的出现为人工智能开辟了新路径,尤其是在自动驾驶领域,它提供了更强的理解与推理能力。本文介绍了LimSim++,这是专为(M)LLMs在自动驾驶中的应用而设计的LimSim扩展版本。针对现有仿真平台的局限性,LimSim++满足了对支持自动驾驶持续学习与提升泛化能力的长期闭环基础设施的需求。该平台可提供长时长、多场景的仿真,为(M)LLM驱动的车辆提供关键信息。用户可开展提示工程、模型评估与框架优化工作,使LimSim++成为兼具科研与实用价值的多功能工具。本文还提出了一个基线(M)LLM驱动框架,并通过多场景下的定量实验完成了系统验证。LimSim++的开源资源可访问:https://pjlab-adg.github.io/limsim-plus/。
英文摘要:
The emergence of Multimodal Large Language Models ((M)LLMs) has ushered in new avenues in artificial intelligence, particularly for autonomous driving by offering enhanced understanding and reasoning capabilities. This paper introduces LimSim++, an extended version of LimSim designed for the application of (M)LLMs in autonomous driving. Acknowledging the limitations of existing simulation platforms, LimSim++ addresses the need for a long-term closed-loop infrastructure supporting continuous learning and improved generalization in autonomous driving. The platform offers extended-duration, multi-scenario simulations, providing crucial information for (M)LLM-driven vehicles. Users can engage in prompt engineering, model evaluation, and framework enhancement, making LimSim++ a versatile tool for research and practice. This paper additionally introduces a baseline (M)LLM-driven framework, systematically validated through quantitative experiments across diverse scenarios. The open-source resources of LimSim++ are available at: https://pjlab-adg.github.io/limsim-plus/.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。