arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2108.00256eess.SYcs.SY
收藏

基于深度强化学习的混合电力推进系统智能能量管理框架

An Intelligent Energy Management Framework for Hybrid-Electric Propulsion Systems Using Deep Reinforcement Learning

Peng Wu, Julius Partridge, Enrico Anderlini, Yuanchang Liu, Richard Bucknall

摘要:

由可再生能源提供的清洁能源驱动的混合电力推进系统为世界交通系统的脱碳提供了一种有前途的方法。有效的能源管理系统对于此类系统实现最佳运行性能至关重要。然而,开发用于诸如在高度随机环境中操作并且需要对多个电源进行并发控制的船舶的应用的智能能量管理系统提出了挑战。本文提出了一种使用深度强化学习的混合电力推进系统智能能量管理框架。在所提出的框架中,双延迟深度确定性策略梯度代理使用大量的历史负载配置文件进行训练,以生成通用的能量管理策略。该策略是能量管理系统的核心,可以在连续的状态和动作空间中并发控制多个电源。所提出的框架应用于具有多个燃料电池集群和电池的沿海渡轮模型,在应用于未来新型航行时实现了近乎最佳的性价比。

英文摘要:

Hybrid-electric propulsion systems powered by clean energy derived from renewable sources offer a promising approach to decarbonise the world's transportation systems. Effective energy management systems are critical for such systems to achieve optimised operational performance. However, developing an intelligent energy management system for applications such as ships operating in a highly stochastic environment and requiring concurrent control over multiple power sources presents challenges. This article proposes an intelligent energy management framework for hybrid-electric propulsion systems using deep reinforcement learning. In the proposed framework, a Twin-Delayed Deep Deterministic Policy Gradient agent is trained using an extensive volume of historical load profiles to generate a generic energy management strategy. The strategy, i.e. the core of the energy management system, can concurrently control multiple power sources in continuous state and action spaces. The proposed framework is applied to a coastal ferry model with multiple fuel cell clusters and a battery, achieving near-optimal cost performance when applied to novel future voyages.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑