Learning the aerodynamic design of supercritical airfoils through deep reinforcement learning

Abstract

The aerodynamic design of modern civil aircraft requires a true sense of intelligence since it requires a good understanding of transonic aerodynamics and sufficient experience. Reinforcement learning is an artificial general intelligence that can learn sophisticated skills by trial-and-error, rather than simply extracting features or making predictions from data. The present paper utilizes a deep reinforcement learning algorithm to learn the policy for reducing the aerodynamic drag of supercritical airfoils. The policy is designed to take actions based on features of the wall Mach number distribution so that the learned policy can be more general. The initial policy for reinforcement learning is pretrained through imitation learning, and the result is compared with randomly generated initial policies. The policy is then trained in environments based on surrogate models, of which the mean drag reduction of 200 airfoils can be effectively improved by reinforcement learning. The policy is also tested by multiple airfoils in different flow conditions using computational fluid dynamics calculations. The results show that the policy is effective in both the training condition and other similar conditions, and the policy can be applied repeatedly to achieve greater drag reduction.

arXiv comment32 pages, 25 figures

Cited by in corpus (10)

• Machine Learning in Aerodynamic Shape Optimization
• Reinforcement Learning of Control Strategies for Reducing Skin Friction Drag in a Fully Developed Channel Flow
• Study of transfer learning from 2D supercritical airfoils to 3D transonic swept wings
• Generative AI and Process Systems Engineering: The Next Frontier
• Multi-condition multi-objective optimization using deep reinforcement learning
• Multi-fidelity reinforcement learning framework for shape optimization
• Physically Interpretable Feature Learning and Inverse Design of Supercritical Airfoils
• Discovering explicit Reynolds-averaged turbulence closures for turbulent separated flows through deep learning-based symbolic regression with non-linear corrections
• Fast buffet onset prediction and optimization method based on a pre-trained flowfield prediction model
• Adversarial Latent Autoencoder with Self-Attention for Structural Image Synthesis