arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2104.05599eess.SYcs.SY
收藏

基于深度强化学习的主动升沉补偿控制器

Deep Reinforcement Learning Based Controller for Active Heave Compensation

Shrenik Zinage, Abhilash Somayajula

摘要:

升沉补偿是各种海上作业的重要组成部分。它用于各种应用,包括装载或卸载系统,海上钻井,直升机在振荡结构上着陆,以及部署和收回载人潜水器。本文提出了一种基于强化学习(RL)的控制器,采用深度确定性策略梯度(DDPG)算法进行主动升沉补偿。DDPG算法是一种无模型的在线强化学习方法,用于在训练试验期间捕获代理的经验。仿真结果表明,RL控制器的升沉补偿性能比调谐比例-微分控制提高了10%。所提出的方法的性能进行了比较方面的升沉补偿,偏移跟踪,扰动抑制,和噪声衰减。

英文摘要:

Heave compensation is an essential part in various offshore operations. It is used in various applications, which include on-loading or off-loading systems, offshore drilling, landing helicopter on oscillating structures, and deploying and retrieving manned submersibles. In this paper, a reinforcement learning (RL) based controller is proposed for active heave compensation using a deep deterministic policy gradient (DDPG) algorithm. A DDPG algorithm which is a model-free, online reinforcement learning method, is adopted to capture the experience of the agent during the training trials. The simulation results demonstrate up to 10 % better heave compensation performance of RL controller as compared to a tuned Proportional-Derivative Control. The performance of the proposed method is compared with respect to heave compensation, offset tracking, disturbance rejection, and noise attenuation.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑