Active flow control of a turbulent separation bubble through deep reinforcement learning

Abstract

The control efficacy of classical periodic forcing and deep reinforcement learning (DRL) is assessed for a turbulent separation bubble (TSB) at $R{e}_{\tau }=180$ on the upstream region before separation occurs. The TSB can resemble a separation phenomenon naturally arising in wings, and a successful reduction of the TSB can have practical implications in the reduction of the aviation carbon footprint. We find that the classical zero-net-mas-flux (ZNMF) periodic control is able to reduce the TSB by 15.7%. On the other hand, the DRL-based control achieves 25.3% reduction and provides a smoother control strategy while also being ZNMF. To the best of our knowledge, the current test case is the highest Reynolds-number flow that has been successfully controlled using DRL to this date. In future work, these results will be scaled to well-resolved large-eddy simulation grids. Furthermore, we provide details of our open-source CFD-DRL framework suited for the next generation of exascale computing machines.

arXiv comment19 pages, 14 figures, 3 tables

References in corpus (8)

• Artificial Neural Networks trained through Deep Reinforcement Learning discover control strategies for active flow control
• Direct numerical simulation of a self-similar adverse pressure gradient turbulent boundary layer at the verge of separation
• Controlling Rayleigh-Bénard convection via Reinforcement Learning
• Deep Reinforcement Learning for Turbulence Modeling in Large Eddy Simulations
• Reinforcement Learning of Control Strategies for Reducing Skin Friction Drag in a Fully Developed Channel Flow
• Spatio-temporal dynamics of turbulent separation bubbles
• Deep learning of the spanwise-averaged Navier-Stokes equations
• Active flow control for three-dimensional cylinders through deep reinforcement learning

Cited by in corpus (3)

• WaterLily.jl: A differentiable and backend-agnostic Julia solver for incompressible viscous flow around dynamic bodies
• Deep reinforcement learning for the management of the wall regeneration cycle in wall-bounded turbulent flows
• Model Predictive and Reinforcement Learning Methods for Active Flow Control of an Airfoil with Dual-point Excitation of Plasma Actuators