In this paper, a novel mechanism-driven reinforcement learning framework is proposed for airfoil shape optimization. To validate the framework, a reward function is designed and analyzed, from which the equivalence between the maximizing the cumulative reward and achieving the optimization objectives is guaranteed theoretically. To establish a quality exploration, and to obtain an accurate reward from the environment, an efficient solver for steady Euler equations is employed in the reinforcement learning method. The solver utilizes the Bézier curve to describe the shape of the airfoil, and a Newton-geometric multigrid method for the solution. In particular, a dual-weighted residual-based h-adaptive method is used for efficient calculation of target functional. To effectively streamline the airfoil shape during the deformation process, we introduce the Laplacian smoothing, and propose a Bézier fitting strategy, which not only remits mesh tangling but also guarantees a precise manipulation of the geometry. In addition, a neural network architecture is designed based on an attention mechanism to make the learning process more sensitive to the minor change of the airfoil geometry. Numerical experiments demonstrate that our framework can handle the optimization problem with hundreds of design variables. It is worth mentioning that, prior to this work, there are limited works combining such high-fidelity partial differential equatons framework with advanced reinforcement learning algorithms for design problems with such high dimensionality.
Transfer learning-enhanced deep reinforcement learning for aerodynamic airfoil optimisation subject to structural constraints
ETSIAE-UPM-School of Aeronautics, Universidad Politécnica de Madrid, Plaza Cardenal Cisneros 3, E-28040 Madrid, Spain(西班牙马德里理工大学航空航天学院);Institute for Cross-Disciplinary Physics(跨学科物理研究所);Center for Computational Simulation, Universidad Politécnica de Madrid, Campus de Montegancedo, Boadilla del Monte, 28660 Madrid, Spain(马德里理工大学计算仿真中心)
Shocks Under Control: Taming Transonic Compressible Flow over an RAE2822 Airfoil with Deep Reinforcement Learning
Aerospace Engineering Department, Worcester Polytechnic Institute(航空航天工程系,沃斯特理工学院);Department of Aerospace Engineering, University of Michigan(航空航天工程系,密歇根大学)
Optimizing Airborne Wind Energy with Reinforcement Learning
University of Groningen(格罗宁根大学);SISSA International School for Advanced Studies(SISSA国际高等研究院);PSL University(巴黎文理研究大学);CNRS(法国国家科学研究中心);Sorbonne Université(索邦大学);Université de Paris(巴黎大学);Université Libre de Bruxelles(布鲁塞尔自由大学)
Reinforcement Learning for Accelerated Aerodynamic Shape Optimisation
Software Competence Center Hagenberg (SCCH)(软件竞争力中心哈根贝格);Institut für Strömungsmechanik und Wärmeübertragung, TU Wien(流体力学与传热研究所,维也纳技术大学);CERBSim GmbH(CERBSim公司)
SINDy-RL: Interpretable and Efficient Model-Based Reinforcement Learning
Department of Mechanical Engineering, University of Washington, Seattle, WA 98195, USA(华盛顿大学机械工程系);Data Science and Artificial Intelligence Department, The Aerospace Corporation, El Segundo, CA 90245(航空航天公司数据科学与人工智能部);Department of Aeronautics, Imperial College, London SW7 2AZ, United Kingdom(帝国理工学院航空系);Department of Applied Mathematics, University of Washington, Seattle, WA 98195(华盛顿大学应用数学系);Department of Electrical and Computer Engineering, University of Washington, Seattle, WA 98195(华盛顿大学电气与计算机工程系)
Multi-Target Landmark Detection with Incomplete Images via Reinforcement Learning and Shape Prior
Fudan University(复旦大学);University of Oxford(牛津大学);Shanghai Jiao Tong University(上海交通大学);University of Chinese Academy of Sciences(中国科学院大学);Huashan Hospital, Fudan University(复旦大学附属华山医院);Zhong Shan Hospital, Fudan University(复旦大学附属中山医院)