arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2403.04329math.NAcs.CEcs.LGcs.NA
收藏

翼型形状优化的机制驱动强化学习框架

A mechanism-driven reinforcement learning framework for shape optimization of airfoils

University of Macau(澳门大学)

Jingfeng Wang, Guanghui Hu

AI总结:

提出机制驱动强化学习框架,通过理论等价奖励设计、高效欧拉求解器与注意力网络,实现数百变量翼型形状优化。

摘要:

本文提出了一种新颖的机制驱动强化学习框架,用于翼型形状优化。为验证该框架,设计并分析了一个奖励函数,从理论上保证了最大化累积奖励与实现优化目标之间的等价性。为了建立高质量的探索并从环境中获得准确的奖励,在强化学习方法中采用了稳态欧拉方程的高效求解器。该求解器利用贝塞尔曲线描述翼型形状,并采用牛顿-几何多重网格方法进行求解。特别地,使用基于对偶加权残差的h自适应方法高效计算目标泛函。为了在变形过程中有效简化翼型形状,我们引入了拉普拉斯平滑,并提出了一种贝塞尔拟合策略,该策略不仅缓解了网格纠缠,还保证了几何形状的精确操控。此外,基于注意力机制设计了一种神经网络架构,使学习过程对翼型几何的微小变化更加敏感。数值实验表明,我们的框架能够处理具有数百个设计变量的优化问题。值得一提的是,在此工作之前,将这种高保真偏微分方程框架与先进强化学习算法相结合以解决如此高维度设计问题的研究非常有限。

英文摘要:

In this paper, a novel mechanism-driven reinforcement learning framework is proposed for airfoil shape optimization. To validate the framework, a reward function is designed and analyzed, from which the equivalence between the maximizing the cumulative reward and achieving the optimization objectives is guaranteed theoretically. To establish a quality exploration, and to obtain an accurate reward from the environment, an efficient solver for steady Euler equations is employed in the reinforcement learning method. The solver utilizes the Bézier curve to describe the shape of the airfoil, and a Newton-geometric multigrid method for the solution. In particular, a dual-weighted residual-based h-adaptive method is used for efficient calculation of target functional. To effectively streamline the airfoil shape during the deformation process, we introduce the Laplacian smoothing, and propose a Bézier fitting strategy, which not only remits mesh tangling but also guarantees a precise manipulation of the geometry. In addition, a neural network architecture is designed based on an attention mechanism to make the learning process more sensitive to the minor change of the airfoil geometry. Numerical experiments demonstrate that our framework can handle the optimization problem with hundreds of design variables. It is worth mentioning that, prior to this work, there are limited works combining such high-fidelity partial differential equatons framework with advanced reinforcement learning algorithms for design problems with such high dimensionality.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑