arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2003.14358physics.flu-dyncs.LGcs.SYeess.SY
收藏

基于强化学习的Rayleigh-Bénard对流控制

Controlling Rayleigh-Bénard convection via Reinforcement Learning

Eindhoven University of Technology(埃因霍温理工大学);University of Rome Tor Vergata(罗马第二大学);CNR-IAC(国家研究委员会建筑科学研究所)

Gerben Beintema, Alessandro Corbetta, Luca Biferale, Federico Toschi

摘要:

热对流在自然界和许多工业应用中普遍存在。确定有效的控制策略,例如,在固定的外部温度梯度下抑制或增强对流换热是一个突出的基础和技术问题。在这项工作中,我们探索了一种新的方法,基于最先进的强化学习(RL)算法,该算法能够通过将小的温度波动应用于系统的下边界来显着减少二维Rayleigh-Bénard系统中的热传输。通过使用数值模拟,我们表明,我们的RL为基础的控制是能够稳定的导电制度,使对流的发生到瑞利数$Ra_c \approx 3 \cdot 10^4$,而在不受控制的情况下,它持有$Ra_{c}=1708$。此外,对于$Ra > 3 \cdot 10^4$,我们的方法优于其他国家的最先进的控制算法,减少约$2.5$的因子的热通量。在手稿的最后一部分,我们解决了与控制不稳定和混沌动力学有关的理论限制,如这里所考虑的。我们表明,可控性受到阻碍的可观测性和/或能力的致动行动,这可以量化的特征时间延迟。当这些延迟变得与系统的李雅普诺夫时间相当时,控制变得不可能。

英文摘要:

Thermal convection is ubiquitous in nature as well as in many industrial applications. The identification of effective control strategies to, e.g., suppress or enhance the convective heat exchange under fixed external thermal gradients is an outstanding fundamental and technological issue. In this work, we explore a novel approach, based on a state-of-the-art Reinforcement Learning (RL) algorithm, which is capable of significantly reducing the heat transport in a two-dimensional Rayleigh-Bénard system by applying small temperature fluctuations to the lower boundary of the system. By using numerical simulations, we show that our RL-based control is able to stabilize the conductive regime and bring the onset of convection up to a Rayleigh number $Ra_c \approx 3 \cdot 10^4$, whereas in the uncontrolled case it holds $Ra_{c}=1708$. Additionally, for $Ra > 3 \cdot 10^4$, our approach outperforms other state-of-the-art control algorithms reducing the heat flux by a factor of about $2.5$. In the last part of the manuscript, we address theoretical limits connected to controlling an unstable and chaotic dynamics as the one considered here. We show that controllability is hindered by observability and/or capabilities of actuating actions, which can be quantified in terms of characteristic time delays. When these delays become comparable with the Lyapunov time of the system, control becomes impossible.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑