arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2601.17801physics.flu-dyn
收藏

基于量子强化学习的主动流动控制

Quantum reinforcement learning-based active flow control

The Hong Kong Polytechnic University(香港理工大学)

Hongfu Zhang, Hui Tang

AI总结:

本研究提出基于量子强化学习的主动流动控制框架,利用变分量子电路与PPO算法,通过抑制涡旋脱落实现阻力降低,验证了量子增强学习在复杂流体动力学问题中的应用潜力。

摘要:

主动流动控制仍是一个重大挑战,因为流体动力学具有高维、非线性性质。量子机器学习可能在解决这些问题上证明有效,因为量子计算在某些方面优于传统计算。因此,本研究开发了一个基于量子强化学习(QRL)的主动流动控制框架,将变分量子电路(VQCs)与近端策略优化(PPO)算法相结合,以学习实时控制器。首先,我们测试了QRL在CartPole问题中的表现。QRL表现出参数效率和增强的学习能力,表明VQC是推进RL的有前途的候选者,特别是在需要计算效率和鲁棒性能的场景中。通过QRL测试了圆柱体在雷诺数为100时的主动控制。我们的混合架构将高维流动状态编码到量子策略网络中,生成连续的吹气/吸气动作在圆柱体表面,从而抑制涡旋脱落以实现阻力降低。数值模拟显示QRL成功降低了平均阻力并抑制了升力振荡。流场分析证实QRL控制有效抑制了大尺度涡旋脱落,导致与未控制基线相比更狭窄的尾迹。这些结果验证了量子增强学习在解决复杂流体动力学问题中的潜力。所提出的QRL框架为量子-AI加速解决方案在航空航天设计、节能涡轮机械和其他涉及复杂流-结构相互作用的应用中建立了有前景的蓝图。

英文摘要:

Active flow control remains a significant challenge due to the high-dimensional, nonlinear nature of fluid dynamics. Quantum machine learning may prove effective in addressing these issues, given that quantum computing possesses superiority over traditional computing in some extend. Thus, this study developed a quantum reinforcement learning (QRL) based active flow control framework, integrating variational quantum circuits (VQCs) with the proximal policy optimization (PPO) algorithm to learn a real time controller. Firstly, we tested the QRL in a CartPole problem. The QRL shows parameter efficiency and enhanced learning capability, indicating VQC acts as promising candidates for advancing RL, particularly in scenarios requiring both computational efficiency and robust performance. The active control of flow past a square circular cylinder at a Reynolds number of 100 was tested via QRL. Our hybrid architecture encodes high-dimensional flow states into a quantum policy network, which generates continuous blowing/suction actions on the cylinder surface, and thus suppress the vortex shedding to achieve drag reduction. Numerical simulations demonstrate the QRL successfully reduces the mean drag and attenuates lift oscillations. Flow field analysis confirms that QRL control effectively suppresses large-scale vortex shedding, leading to a narrower wake compared to the uncontrolled baseline. These results validate the potential of quantum-enhanced learning for tackling complex fluid dynamics problems. The proposed QRL framework establishes a promising blueprint for quantum-AI accelerated solutions in aerospace design, energy-efficient turbomachinery, and other applications involving sophisticated fluid-structure interactions.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑