arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2108.03236cs.LGmath.OC
收藏

基于强化学习的电动汽车充电站运营高效表示

Efficient Representation for Electric Vehicle Charging Station Operations using Reinforcement Learning

The University of Texas at Austin(德克萨斯大学奥斯汀分校)

Kyung-bin Kwon, Hao Zhu

摘要:

电动汽车充电站(EVCS)的有效运行对于实现电气化交通的快速过渡至关重要。为了使用强化学习(RL)来解决这个问题,状态/动作空间的维度与EV的数量成比例,因此非常大且随时间变化。这个维度问题影响了通用RL算法的效率和收敛特性。我们开发的聚合方案,是基于电动汽车充电的紧急情况,即松弛值。采用最小松弛优先(LLF)规则,只考虑总的充电功率的电动汽车控制系统,以确保个人的电动汽车调度的可行性。此外,我们提出了一个等价的状态聚合,可以保证达到相同的最优策略。在此基础上,利用策略梯度方法,对线性高斯策略进行参数优化。数值结果验证了所提出的表示方法在获得更高的回报和更有效的政策相比,现有的近似为基础的方法的性能改善。

英文摘要:

Effectively operating electrical vehicle charging station (EVCS) is crucial for enabling the rapid transition of electrified transportation. To solve this problem using reinforcement learning (RL), the dimension of state/action spaces scales with the number of EVs and is thus very large and time-varying. This dimensionality issue affects the efficiency and convergence properties of generic RL algorithms. We develop aggregation schemes that are based on the emergency of EV charging, namely the laxity value. A least-laxity first (LLF) rule is adopted to consider only the total charging power of the EVCS which ensures the feasibility of individual EV schedules. In addition, we propose an equivalent state aggregation that can guarantee to attain the same optimal policy. Based on the proposed representation, policy gradient method is used to find the best parameters for the linear Gaussian policy . Numerical results have validated the performance improvement of the proposed representation approaches in attaining higher rewards and more effective policies as compared to existing approximation based approach.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑