arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2402.12666cs.RO
收藏

预训练Transformer赋能策略与人工引导微调用于自动驾驶车辆端到端导航

Pre-trained Transformer-Enabled Strategies with Human-Guided Fine-Tuning for End-to-end Navigation of Autonomous Vehicles

the Hong Kong Polytechnic University(香港理工大学);University of Science and Technology of China(中国科学技术大学);Nanyang Technological University(南洋理工大学)

Dong Hu, Chao Huang, Jingda Wu, Hongbo Gao

AI总结:

本研究提出一种结合Transformer模块和人工引导强化学习微调的端到端自动驾驶训练模型,通过行为克隆预训练和人类交互微调,提升数据效率、泛化能力及驾驶安全性与可靠性。

摘要:

自动驾驶(AD)技术利用人工智能,致力于实现车辆自动化。端到端策略通过整合感知、决策和控制来简化传统驾驶系统,为高级驾驶功能提供了新途径。尽管其潜力巨大,当前挑战包括数据效率、训练复杂性和泛化能力差。本研究通过一种新颖的端到端自动驾驶训练模型来解决这些问题,增强系统的适应性和智能性。该模型将Transformer模块纳入策略网络,进行初始行为克隆(BC)预训练以更新梯度。随后,通过带人工引导的强化学习(RLHG)进行微调,使模型适应特定驾驶环境,旨在超越模仿学习(IL)的性能极限。微调过程涉及人类交互,通过监督、干预、演示和奖励反馈引导模型获得更高效、更安全的驾驶行为。仿真结果表明,该框架加速了学习,实现了精确控制,并显著提高了安全性和可靠性。与其他先进基线方法相比,所提出的方法在具有挑战性的自动驾驶任务中表现优异。Transformer模块的引入和人工引导微调为自动驾驶领域的研究和应用提供了有价值的见解和方法。

英文摘要:

Autonomous driving (AD) technology, leveraging artificial intelligence, strives for vehicle automation. End-toend strategies, emerging to simplify traditional driving systems by integrating perception, decision-making, and control, offer new avenues for advanced driving functionalities. Despite their potential, current challenges include data efficiency, training complexities, and poor generalization. This study addresses these issues with a novel end-to-end AD training model, enhancing system adaptability and intelligence. The model incorporates a Transformer module into the policy network, undergoing initial behavior cloning (BC) pre-training for update gradients. Subsequently, fine-tuning through reinforcement learning with human guidance (RLHG) adapts the model to specific driving environments, aiming to surpass the performance limits of imitation learning (IL). The fine-tuning process involves human interactions, guiding the model to acquire more efficient and safer driving behaviors through supervision, intervention, demonstration, and reward feedback. Simulation results demonstrate that this framework accelerates learning, achieving precise control and significantly enhancing safety and reliability. Compared to other advanced baseline methods, the proposed approach excels in challenging AD tasks. The introduction of the Transformer module and human-guided fine-tuning provides valuable insights and methods for research and applications in the AD field.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑