arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1906.07672math.OCnlin.CDphysics.flu-dyn
收藏

基于深度强化学习的混沌系统控制

Control of chaotic systems by Deep Reinforcement Learning

Michele Alessandro Bucci, Onofrio Semeraro, Alexandre Allauzen, Guillaume Wisniewski, Laurent Cordier, Lionel Mathelin

摘要:

深度强化学习(DRL)被应用于控制由一维Kuramoto-Sivashinsky(KS)方程控制的非线性混沌系统。DRL使用强化学习原理来确定最优控制解决方案,并使用深度神经网络来近似值函数和控制策略。最近的应用表明,DRL可以在复杂的认知任务中实现超人的性能。在这项工作中,我们表明,使用有限的,本地化的驱动,部分知识的状态的基础上有限的传感器测量,和无模型DRL控制器,它是可能的稳定KS系统的动态周围的不稳定的固定解决方案,这里被认为是目标状态。通过考虑从不同的初始条件产生的相空间中的几个轨迹的控制器的鲁棒性进行测试,我们表明,DRL总是能够驱动和稳定的动态目标状态。KS系统的复杂性,定义的DRL控制策略的可能性,仅仅依赖于本地测量的系统,和他们的效率在控制其非线性动力学铺平了道路RL方法在控制复杂的流体系统,如湍流边界层,湍流混合器或多相流的应用。

英文摘要:

Deep Reinforcement Learning (DRL) is applied to control a nonlinear, chaotic system governed by the one-dimensional Kuramoto-Sivashinsky (KS) equation. DRL uses reinforcement learning principles for the determination of optimal control solutions and deep Neural Networks for approximating the value function and the control policy. Recent applications have shown that DRL may achieve superhuman performance in complex cognitive tasks. In this work, we show that using restricted, localized actuations, partial knowledge of the state based on limited sensor measurements, and model-free DRL controllers, it is possible to stabilize the dynamics of the KS system around its unstable fixed solutions, here considered as target states. The robustness of the controllers is tested by considering several trajectories in the phase-space emanating from different initial conditions; we show that the DRL is always capable of driving and stabilizing the dynamics around the target states. The complexity of the KS system, the possibility of defining the DRL control policies by solely relying on the local measurements of the system, and their efficiency in controlling its nonlinear dynamics pave the way for the application of RL methods in control of complex fluid systems such as turbulent boundary layers, turbulent mixers or multiphase flows.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑