Comparative analysis of machine learning methods for active flow control

Abstract

Machine learning frameworks such as Genetic Programming (GP) and Reinforcement Learning (RL) are gaining popularity in flow control. This work presents a comparative analysis of the two, bench-marking some of their most representative algorithms against global optimization techniques such as Bayesian Optimization (BO) and Lipschitz global optimization (LIPO). First, we review the general framework of the model-free control problem, bringing together all methods as black-box optimization problems. Then, we test the control algorithms on three test cases. These are (1) the stabilization of a nonlinear dynamical system featuring frequency cross-talk, (2) the wave cancellation from a Burgers' flow and (3) the drag reduction in a cylinder wake flow. We present a comprehensive comparison to illustrate their differences in exploration versus exploitation and their balance between `model capacity' in the control law definition versus `required complexity'. We believe that such a comparison paves the way toward the hybridization of the various methods, and we offer some perspective on their future development in the literature on flow control problems.

submitted to Journal of Fluid Mechanics

References in corpus (4)

• Closed-loop separation control using machine learning
• Robust active flow control over a range of Reynolds numbers using an artificial neural network trained through deep reinforcement learning
• Reinforcement-learning-based control of confined cylinder wakes with stability analyses
• Machine learning flow control with few sensor feedback and measurement noise

Cited by in corpus (11)

• Recent advances in applying deep reinforcement learning for flow control: perspectives and future directions
• Dynamic Feature-based Deep Reinforcement Learning for Flow Control of Circular Cylinder with Sparse Surface Pressure Sensing
• Effective control of two-dimensional Rayleigh--Bénard convection: invariant multi-agent reinforcement learning is all you need
• Machine learning flow control with few sensor feedback and measurement noise
• Deep Learning Closure Models for Large-Eddy Simulation of Flows around Bluff Bodies
• Reinforcement-learning-based control of convectively-unstable flows
• Experimental analysis of heat and mass transfer in non-isothermal sloshing using a model-based inverse method
• Data-driven modeling of hypersonic reentry flow with heat and mass transfer
• Flow control by a hybrid use of machine learning and control theory
• How to Control Hydrodynamic Force on Fluidic Pinball via Deep Reinforcement Learning
• Integral modelling and Reinforcement Learning control of 3D liquid metal coating on a moving substrate