Bluff body uses deep-reinforcement-learning trained active flow control to achieve hydrodynamic stealth

Abstract

We propose a novel active-flow-control (AFC) strategy for bluff bodies to hide their hydrodynamic traces from predators. A group of windward-suction-leeward-blowing (WSLB) actuators are adopted to control the wake of a circular cylinder submerged in a uniform flow. An array of velocity sensors are deployed in the near wake to provide feedback signals. Through the data-driven deep reinforcement learning (DRL), effective control strategies are trained for the WSLB actuation to mitigate the cylinder's hydrodynamic signatures, i.e., strong shears and periodically shed vortices. Only a 0.29% deficit in streamwise velocity is detected, which is a 99.5% reduction from the uncontrolled value. The same control strategy is found to be also effective when the cylinder undergoes transverse vortex-induced vibration (VIV). The findings from this study can shed some lights on the design and operation of underwater structures and robotics to achieve hydrodynamic stealth.

References in corpus (11)

• Adam: A Method for Stochastic Optimization
• Machine Learning for Fluid Mechanics
• Numerical Simulations of Particulate Suspensions via a Discretized Boltzmann Equation Part I. Theoretical Foundation
• Deep learning for universal linear embeddings of nonlinear dynamics
• Broadband Acoustic Cloak for Ultrasound Waves
• Artificial Neural Networks trained through Deep Reinforcement Learning discover control strategies for active flow control
• Flow Navigation by Smart Microswimmers via Reinforcement Learning
• Accelerating Deep Reinforcement Learning strategies of Flow Control through a multi-environment approach
• Robust active flow control over a range of Reynolds numbers using an artificial neural network trained through deep reinforcement learning
• Applying deep reinforcement learning to active flow control in turbulent conditions
• Fluid flow control with transformation media

Cited by in corpus (6)

• Recent advances in applying deep reinforcement learning for flow control: perspectives and future directions
• Dynamic Feature-based Deep Reinforcement Learning for Flow Control of Circular Cylinder with Sparse Surface Pressure Sensing
• Effective control of two-dimensional Rayleigh--Bénard convection: invariant multi-agent reinforcement learning is all you need
• Latent feedback control of distributed systems in multiple scenarios through deep learning-based reduced order models
• Real-time optimal control of high-dimensional parametrized systems by deep learning-based reduced order models
• How to Control Hydrodynamic Force on Fluidic Pinball via Deep Reinforcement Learning