DDM-Lag:一种基于扩散的自动驾驶车辆决策模型,具有拉格朗日安全增强
DDM-Lag : A Diffusion-based Decision-making Model for Autonomous Vehicles with Lagrangian Safety Enhancement
AI总结:
本文提出DDM-Lag模型,将自动驾驶序贯决策建模为扩散生成问题,结合行为克隆与Q学习的混合策略更新及拉格朗日安全约束,在多种驾驶任务中验证了其在安全性和整体效能上的优势。
摘要:
决策是自动驾驶车辆(AVs)领域的关键组成部分,在应对自动驾驶的复杂性方面发挥着至关重要的作用。在数据驱动方法不断演变的背景下,提升复杂场景中的决策性能已成为一个突出的研究焦点。尽管取得了相当大的进展,当前基于学习的决策方法仍存在改进空间,特别是在策略表达和安全保障方面。为应对这些挑战,我们提出了DDM-Lag,一种扩散决策模型,并辅以基于拉格朗日的安全增强。本工作将自动驾驶中固有的序贯决策挑战概念化为生成建模问题,采用扩散模型作为吸收决策模式的媒介。我们为扩散模型引入了一种混合策略更新策略,融合了行为克隆和Q学习的原理,同时构建了Actor-Critic架构以促进更新。为了在模型探索过程中增加一层安全保障,我们引入了额外的安全约束,采用基于拉格朗日松弛的复杂策略优化技术,以全面优化策略学习过程。我们提出的决策方法在一系列驾驶任务上进行了实证评估,这些任务具有不同的复杂程度和环境背景。与既有基线方法的对比分析阐明了我们模型的优越性能,特别是在安全性和整体效能维度上。
英文摘要:
Decision-making stands as a pivotal component in the realm of autonomous vehicles (AVs), playing a crucial role in navigating the intricacies of autonomous driving. Amidst the evolving landscape of data-driven methodologies, enhancing decision-making performance in complex scenarios has emerged as a prominent research focus. Despite considerable advancements, current learning-based decision-making approaches exhibit potential for refinement, particularly in aspects of policy articulation and safety assurance. To address these challenges, we introduce DDM-Lag, a Diffusion Decision Model, augmented with Lagrangian-based safety enhancements. This work conceptualizes the sequential decision-making challenge inherent in autonomous driving as a problem of generative modeling, adopting diffusion models as the medium for assimilating patterns of decision-making. We introduce a hybrid policy update strategy for diffusion models, amalgamating the principles of behavior cloning and Q-learning, alongside the formulation of an Actor-Critic architecture for the facilitation of updates. To augment the model's exploration process with a layer of safety, we incorporate additional safety constraints, employing a sophisticated policy optimization technique predicated on Lagrangian relaxation to refine the policy learning endeavor comprehensively. Empirical evaluation of our proposed decision-making methodology was conducted across a spectrum of driving tasks, distinguished by their varying degrees of complexity and environmental contexts. The comparative analysis with established baseline methodologies elucidates our model's superior performance, particularly in dimensions of safety and holistic efficacy.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。