Multi-scale Deep Neural Network (MscaleDNN) Methods for Oscillatory Stokes Flows in Complex Domains

Abstract

In this paper, we study a multi-scale deep neural network (MscaleDNN) as a meshless numerical method for computing oscillatory Stokes flows in complex domains. The MscaleDNN employs a multi-scale structure in the design of its DNN using radial scalings to convert the approximation of high frequency components of the highly oscillatory Stokes solution to one of lower frequencies. The MscaleDNN solution to the Stokes problem is obtained by minimizing a loss function in terms of L2 normof the residual of the Stokes equation. Three forms of loss functions are investigated based on vorticity-velocity-pressure, velocity-stress-pressure, and velocity-gradient of velocity-pressure formulations of the Stokes equation. We first conduct a systematic study of the MscaleDNN methods with various loss functions on the Kovasznay flow in comparison with normal fully connected DNNs. Then, Stokes flows with highly oscillatory solutions in a 2-D domain with six randomly placed holes are simulated by the MscaleDNN. The results show that MscaleDNN has faster convergence and consistent error decays in the simulation of Kovasznay flow for all four tested loss functions. More importantly, the MscaleDNN is capable of learning highly oscillatory solutions when the normal DNNs fail to converge.

References in corpus (4)

• Solving high-dimensional partial differential equations using deep learning
• NSFnets (Navier-Stokes Flow nets): Physics-informed neural networks for the incompressible Navier-Stokes equations
• Frequency Principle: Fourier Analysis Sheds Light on Deep Neural Networks
• Multi-scale Deep Neural Network (MscaleDNN) for Solving Poisson-Boltzmann Equation in Complex Domains

Cited by in corpus (13)

• Gradient-enhanced physics-informed neural networks for forward and inverse PDE problems
• On the eigenvector bias of Fourier feature networks: From regression to solving multi-scale PDEs with physics-informed neural networks
• Physics-informed Neural Networks (PINNs) for Wave Propagation and Full Waveform Inversions
• Deep Nitsche Method: Deep Ritz Method with Essential Boundary Conditions
• A physics-informed neural network for quantifying the microstructure properties of polycrystalline Nickel using ultrasound data
• Characterizing possible failure modes in physics-informed neural networks
• Physics-Informed Deep Learning of Rate-and-State Fault Friction
• Linear Frequency Principle Model to Understand the Absence of Overfitting in Neural Networks
• Reproducing Activation Function for Deep Learning
• Physics Encoded Blocks in Residual Neural Network Architectures for Digital Twin Models
• Hierarchical Learning to Solve Partial Differential Equations Using Physics-Informed Neural Networks
• Generalization Error Analysis of Neural networks with Gradient Based Regularization
• Fourier-domain Variational Formulation and Its Well-posedness for Supervised Learning