arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2002.02060eess.SYcs.SY
收藏

基于强化学习的锂离子电池快速充电控制策略

Reinforcement Learning-based Fast Charging Control Strategy for Li-ion Batteries

Saehong Park, Andrea Pozzi, Michael Whitmeyer, Hector Perez, Won Tae Joe, Davide M Raimondo, Scott Moura

摘要:

锂离子电池社区面临的最关键挑战之一是寻找最短的充电时间,而不会不可逆地损坏电池。这可以归结为根据电池模型求解大规模非线性最优控制问题。在此背景下,一些基于模型的技术已经在文献中被提出。然而,这些策略的有效性受到模型复杂性和不确定性的显著限制。此外,难以跟踪与老化相关的参数并重新调整基于模型的控制策略。为了克服这些限制,本文提出了一种基于无模型强化学习框架的安全约束快速充电策略。特别是,我们专注于基于策略梯度的演员批评算法,即,深度确定性策略梯度(DDPG),以处理连续的动作集和集合。当一个简化的电化学模型被认为是真实的工厂时,在模拟中评估该建议的有效性。最后,在考虑状态约简的情况下,强调了所提出的策略对环境参数变化的在线适应性。

英文摘要:

One of the most crucial challenges faced by the Li-ion battery community concerns the search for the minimum time charging without irreversibly damaging the cells. This can fall into solving large-scale nonlinear optimal control problems according to a battery model. Within this context, several model-based techniques have been proposed in the literature.However, the effectiveness of such strategies is significantly limited by model complexity and uncertainty. Additionally, it is difficult to track parameters related to aging and re-tune the model-based control policy. With the aim of overcoming these limitations, in this paper we propose a fast-charging strategy subject to safety constraints which relies on a model-free reinforcement learning framework. In particular, we focus on the policy gradient-based actor-critic algorithm, i.e., deep deterministic policy gradient (DDPG), in order to deal with continuous sets of actions and sets. The validity of the proposal is assessed in simulation when a reduced electrochemical model is considered as the real plant. Finally, the online adaptability of the proposed strategy in response to variations of the environment parameters is highlighted with consideration of state reduction.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑