一种基于嵌套图强化学习的生态编队决策策略
A Nested Graph Reinforcement Learning-based Decision-making Strategy for Eco-platooning
AI总结:
针对大规模混合编队的虚拟瓶颈问题,提出嵌套图强化学习决策策略,通过嵌套交通图表示和时空加权图多头注意力提升协同决策能力,经I-24数据集验证,吞吐量提升10%、能耗降9%。
摘要:
编队技术以其精准的车辆控制、交通流优化和能效提升特性而闻名。然而,在大规模混合编队中,车辆异质性和不可预测的交通状况会导致虚拟瓶颈。这些瓶颈会降低交通吞吐量并增加编队内的能耗。为应对这些挑战,我们提出了一种基于嵌套图强化学习的决策策略。该策略改进了协同决策,在保障能效的同时缓解拥堵。我们提出了嵌套交通图表示理论,用于在非欧空间中映射车辆与编队之间的动态交互。通过将时空加权图融入多头注意力机制,我们进一步提升了模型处理局部和全局数据的能力。此外,我们开发了嵌套图强化学习框架,以增强编队的自迭代学习能力。我们利用I-24数据集设计并开展了对比算法实验、泛化性测试和渗透率消融实验,验证了所提策略的有效性。与基线相比,我们的策略将吞吐量提升了10%,能耗降低了9%。具体而言,提高网联自动驾驶车辆(CAVs)的渗透率可显著提升交通吞吐量,但也会增加能耗。
英文摘要:
Platooning technology is renowned for its precise vehicle control, traffic flow optimization, and energy efficiency enhancement. However, in large-scale mixed platoons, vehicle heterogeneity and unpredictable traffic conditions lead to virtual bottlenecks. These bottlenecks result in reduced traffic throughput and increased energy consumption within the platoon. To address these challenges, we introduce a decision-making strategy based on nested graph reinforcement learning. This strategy improves collaborative decision-making, ensuring energy efficiency and alleviating congestion. We propose a theory of nested traffic graph representation that maps dynamic interactions between vehicles and platoons in non-Euclidean spaces. By incorporating spatio-temporal weighted graph into a multi-head attention mechanism, we further enhance the model's capacity to process both local and global data. Additionally, we have developed a nested graph reinforcement learning framework to enhance the self-iterative learning capabilities of platooning. Using the I-24 dataset, we designed and conducted comparative algorithm experiments, generalizability testing, and permeability ablation experiments, thereby validating the proposed strategy's effectiveness. Compared to the baseline, our strategy increases throughput by 10% and decreases energy use by 9%. Specifically, increasing the penetration rate of CAVs significantly enhances traffic throughput, though it also increases energy consumption.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。