arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2007.12560eess.SYcs.LGcs.SY
收藏

基于转移强化学习的真实驾驶条件下的自适应能量管理

Adaptive Energy Management for Real Driving Conditions via Transfer Reinforcement Learning

Chongqing University(重庆大学);University of Waterloo(滑铁卢大学);Waterloo University(滑铁卢大学)

Teng Liu, Wenhao Tan, Xiaolin Tang, Jiaxin Chen, Dongpu Cao

摘要:

提出了一种基于传递强化学习(RL)的并联混合动力汽车(HEV)自适应能量管理方法。这是一个双层次的方法。上一级描述了如何通过驾驶循环变换(DCT)在RL框架中对Q值表进行变换。特别是,计算了不同周期功率请求的转移概率矩阵(TPM),并采用诱导矩阵范数(IMN)作为识别变换差异并确定控制策略变更的关键标准。下层利用无模型强化学习(RL)算法,根据变换后的Q值表和TPM确定相应的控制策略。数值试验表明,通过调节IMN值,可以调节传递性能,传递RL控制器可以获得更高的燃油经济性。结果表明,该方法在计算速度和控制性能上均优于传统RL方法。

英文摘要:

This article proposes a transfer reinforcement learning (RL) based adaptive energy managing approach for a hybrid electric vehicle (HEV) with parallel topology. This approach is bi-level. The up-level characterizes how to transform the Q-value tables in the RL framework via driving cycle transformation (DCT). Especially, transition probability matrices (TPMs) of power request are computed for different cycles, and induced matrix norm (IMN) is employed as a critical criterion to identify the transformation differences and to determine the alteration of the control strategy. The lower-level determines how to set the corresponding control strategies with the transformed Q-value tables and TPMs by using model-free reinforcement learning (RL) algorithm. Numerical tests illustrate that the transferred performance can be tuned by IMN value and the transfer RL controller could receive a higher fuel economy. The comparison demonstrates that the proposed strategy exceeds the conventional RL approach in both calculation speed and control performance.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑