arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2408.06783physics.flu-dyn
收藏

深度强化学习在壁湍流壁再生周期管理中的应用

Deep reinforcement learning for the management of the wall regeneration cycle in wall-bounded turbulent flows

City St George’s, University of London(伦敦大学城市圣乔治学院);TU Munich(慕尼黑工业大学);KTH Royal Institute of Technology(瑞典皇家理工学院)

Giorgio Maria Cavallazzi, Luca Guastoni, Ricardo Vinuesa, Alfredo Pinelli

AI总结:

本文利用深度强化学习管理湍流壁再生周期,通过DRL与DNS求解器结合实现动态流体控制,实验显示DRL可实现与传统方法相当的减阻效果,未来将优化控制策略和计算架构。

摘要:

壁湍流中的壁再生周期是一种复杂的湍流再生机制,尚未完全理解。本研究探讨深度强化学习(DRL)在管理壁再生周期以实现所需流体动力学中的潜力。我们整合了StableBaselines3 DRL库与开源DNS求解器CaNS,创建了一个稳健的动态流体控制平台。DRL智能体与DNS环境交互,学习策略以修改壁边界条件,以优化如减少皮肤摩擦系数或增强某些相干结构特征等目标。初步实验表明DRL能够实现与传统方法相当的减阻率,尽管受限于短时间周期。我们还提出了一种增强速度 streaks 协调性的策略,假设维持直线 streaks 可抑制不稳定性并进一步减少皮肤摩擦。实现利用消息传递接口(MPI)封装,确保Python基于的DRL智能体与DNS求解器之间高效通信,保证在高性能计算架构上的可扩展性。我们的结果强调了DRL在流体控制应用中的前景,并突显了需要更先进的控制定律和目标函数的必要性。未来工作将聚焦于优化作用时间并探索新的计算架构,以扩展DRL在湍流流体管理中的适用性和效率。

英文摘要:

The wall cycle in wall-bounded turbulent flows is a complex turbulence regeneration mechanism that remains not fully understood. This study explores the potential of deep reinforcement learning (DRL) for managing the wall regeneration cycle to achieve desired flow dynamics. We integrate the StableBaselines3 DRL libraries with the open-source DNS solver CaNS to create a robust platform for dynamic flow control. The DRL agent interacts with the DNS environment, learning policies that modify wall boundary conditions to optimize objectives such as the reduction of the skin-friction coefficient or the enhancement of certain coherent structures features. Initial experiments demonstrate the capability of DRL to achieve drag-reduction rates comparable with those achieved via traditional methods, though limited to short time periods. We also propose a strategy to enhance the coherence of velocity streaks, assuming that maintaining straight streaks can inhibit instability and further reduce skin friction. The implementation makes use of the message-passing-interface (MPI) wrappers for efficient communication between the Python-based DRL agent and the DNS solver, ensuring scalability on high-performance computing architectures. Our results highlight the promise of DRL in flow control applications and underscore the need for more advanced control laws and objective functions. Future work will focus on optimizing actuation periods and exploring new computational architectures to extend the applicability and the efficiency of DRL in turbulent flow management.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑