NSFnets (Navier-Stokes Flow nets): Physics-informed neural networks for the incompressible Navier-Stokes equations

Abstract

We employ physics-informed neural networks (PINNs) to simulate the incompressible flows ranging from laminar to turbulent flows. We perform PINN simulations by considering two different formulations of the Navier-Stokes equations: the velocity-pressure (VP) formulation and the vorticity-velocity (VV) formulation. We refer to these specific PINNs for the Navier-Stokes flow nets as NSFnets. Analytical solutions and direct numerical simulation (DNS) databases provide proper initial and boundary conditions for the NSFnet simulations. The spatial and temporal coordinates are the inputs of the NSFnets, while the instantaneous velocity and pressure fields are the outputs for the VP-NSFnet, and the instantaneous velocity and vorticity fields are the outputs for the VV-NSFnet. These two different forms of the Navier-Stokes equations together with the initial and boundary conditions are embedded into the loss function of the PINNs. No data is provided for the pressure to the VP-NSFnet, which is a hidden state and is obtained via the incompressibility constraint without splitting the equations. We obtain good accuracy of the NSFnet simulation results upon convergence of the loss function, verifying that NSFnets can effectively simulate complex incompressible flows using either the VP or the VV formulations. We also perform a systematic study on the weights used in the loss function for the data/physics components and investigate a new way of computing the weights dynamically to accelerate training and enhance accuracy. Our results suggest that the accuracy of NSFnets, for both laminar and turbulent flows, can be improved with proper tuning of weights (manual or dynamic) in the loss function.

References in corpus (10)

• Machine Learning for Fluid Mechanics
• DeepXDE: A deep learning library for solving differential equations
• Turbulence Modeling in the Age of Data
• Adaptive activation functions accelerate convergence in deep and physics-informed neural networks
• Physics Informed Deep Learning (Part I): Data-driven Solutions of Nonlinear Partial Differential Equations
• A public turbulence database cluster and applications to study Lagrangian evolution of velocity increments in turbulence
• A Physics Informed Machine Learning Approach for Reconstructing Reynolds Stress Modeling Discrepancies Based on DNS Data
• Deep Learning of Vortex Induced Vibrations
• Locally adaptive activation functions with slope recovery term for deep and physics-informed neural networks
• Understanding and mitigating gradient pathologies in physics-informed neural networks

Cited by in corpus (134)

• On the eigenvector bias of Fourier feature networks: From regression to solving multi-scale PDEs with physics-informed neural networks
• PhyGeoNet: Physics-Informed Geometry-Adaptive Convolutional Neural Networks for Solving Parameterized Steady-State PDEs on Irregular Domain
• Self-adaptive loss balanced Physics-informed neural networks for the incompressible Navier-Stokes equations
• Physics-informed neural networks for solving Reynolds-averaged Navier$\unicode{x2013}$Stokes equations
• Physics-informed Neural Networks (PINNs) for Wave Propagation and Full Waveform Inversions
• CAN-PINN: A Fast Physics-Informed Neural Network Based on Coupled-Automatic-Numerical Differentiation Method
• Flow over an espresso cup: Inferring 3D velocity and pressure fields from tomographic background oriented schlieren videos via physics-informed neural networks
• Physics-informed graph neural Galerkin networks: A unified framework for solving PDE-governed forward and inverse problems
• Stiff-PINN: Physics-Informed Neural Network for Stiff Chemical Kinetics
• PhyCRNet: Physics-informed Convolutional-Recurrent Network for Solving Spatiotemporal PDEs
• Uncovering near-wall blood flow from sparse data with physics-informed neural networks
• Transfer learning based physics-informed neural networks for solving inverse problems in engineering structures under different loading scenarios
• DeepM&Mnet: Inferring the electroconvection multiphysics fields based on operator approximation by neural networks
• Residual-based attention in physics-informed neural networks
• A two-stage physics-informed neural network method based on conserved quantities and applications in localized wave solutions
• Bridging observation, theory and numerical simulation of the ocean using Machine Learning
• Physics-informed neural network simulation of multiphase poroelasticity using stress-split sequential training
• Deep Learning in Deterministic Computational Mechanics
• Physics-informed PointNet: A deep learning solver for steady-state incompressible flows and thermal fields on multiple sets of irregular geometries
• Physics-Informed Neural Operator for Learning Partial Differential Equations
• A Review of Machine Learning Methods Applied to Structural Dynamics and Vibroacoustic
• A Perspective on Machine Learning Methods in Turbulence Modelling
• Physics-informed neural networks for the shallow-water equations on the sphere
• When Do Extended Physics-Informed Neural Networks (XPINNs) Improve Generalization?
• Meta-learning PINN loss functions
• When and why PINNs fail to train: A neural tangent kernel perspective
• Characterizing possible failure modes in physics-informed neural networks
• Deep learning of free boundary and Stefan problems
• Physics-informed neural networks of the Saint-Venant equations for downscaling a large-scale river model
• Controlled physics-informed data generation for deep learning-based remaining useful life prediction under unseen operation conditions
• Multilevel domain decomposition-based architectures for physics-informed neural networks
• Learning in Sinusoidal Spaces with Physics-Informed Neural Networks
• Physics-informed neural network solution of thermo-hydro-mechanical (THM) processes in porous media
• Explore missing flow dynamics by physics-informed deep learning: the parameterised governing systems
• Long-term predictions of turbulence by implicit U-Net enhanced Fourier neural operator
• Physics-informed neural networks (PINNs) for fluid mechanics: A review
• Unveiling the optimization process of Physics Informed Neural Networks: How accurate and competitive can PINNs be?
• Physics-informed neural network methods based on Miura transformations and discovery of new localized wave solutions
• Estimating density, velocity, and pressure fields in supersonic flow using physics-informed BOS
• Pre-training strategy for solving evolution equations based on physics-informed neural networks
• Inverse modeling of nonisothermal multiphase poromechanics using physics-informed neural networks
• Physics-informed neural networks method in high-dimensional integrable systems
• Physics-informed data based neural networks for two-dimensional turbulence
• Multi-scale Deep Neural Network (MscaleDNN) Methods for Oscillatory Stokes Flows in Complex Domains
• Mosaic Flows: A Transferable Deep Learning Framework for Solving PDEs on Unseen Domains
• Simulating progressive intramural damage leading to aortic dissection using an operator-regression neural network
• Bayesian Physics-Informed Extreme Learning Machine for Forward and Inverse PDE Problems with Noisy Data
• Adaptive Training of Grid-Dependent Physics-Informed Kolmogorov-Arnold Networks
• Mean flow data assimilation based on physics-informed neural networks
• When Geoscience Meets Generative AI and Large Language Models: Foundations, Trends, and Future Challenges
• DropTrack -- automatic droplet tracking using deep learning for microfluidic applications
• Accelerating hydrodynamic simulations of urban drainage systems with physics-guided machine learning
• Data vs. Physics: The Apparent Pareto Front of Physics-Informed Neural Networks
• An extended physics informed neural network for preliminary analysis of parametric optimal control problems
• Finite volume method network for acceleration of unsteady computational fluid dynamics: non-reacting and reacting flows
• Physical Activation Functions (PAFs): An Approach for More Efficient Induction of Physics into Physics-Informed Neural Networks (PINNs)
• An unsupervised latent/output physics-informed convolutional-LSTM network for solving partial differential equations using peridynamic differential operator
• Using neural networks to accelerate the solution of the Boltzmann equation
• Hutchinson Trace Estimation for High-Dimensional and High-Order Physics-Informed Neural Networks
• Finite Volume Graph Network(FVGN): Predicting unsteady incompressible fluid dynamics with finite volume informed neural network
• Energy-based error bound of physics-informed neural network solutions in elasticity
• Physics-Informed Neural Networks for Parametric Compressible Euler Equations
• Physics informed deep learning for computational elastodynamics without labeled data
• HomPINNs: homotopy physics-informed neural networks for solving the inverse problems of nonlinear differential equations with multiple solutions
• PINN Training using Biobjective Optimization: The Trade-off between Data Loss and Residual Loss
• NVIDIA SimNet^{TM}: an AI-accelerated multi-physics simulation framework
• Physics-aware deep neural networks for surrogate modeling of turbulent natural convection
• Physics-constrained Deep Learning for Robust Inverse ECG Modeling
• Deep encoder-decoder hierarchical convolutional neural networks for conjugate heat transfer surrogate modeling
• Physics-informed neural networks for unsteady incompressible flows with time-dependent moving boundaries
• Inferring electrochemical performance and parameters of Li-ion batteries based on deep operator networks
• Physics-Informed Deep Learning of Rate-and-State Fault Friction
• Physics-informed neural networks modeling for systems with moving immersed boundaries: application to an unsteady flow past a plunging foil
• Physics-informed neural networks for understanding shear migration of particles in viscous flow
• Physics-informed neural networks for solving forward and inverse flow problems via the Boltzmann-BGK formulation
• A Generative Modeling Framework for Inferring Families of Biomechanical Constitutive Laws in Data-Sparse Regimes
• Stochastic stiffness identification and response estimation of Timoshenko beams via physics-informed Gaussian processes
• Bayesian neural networks for weak solution of PDEs with uncertainty quantification
• Revisiting Tensor Basis Neural Networks for Reynolds stress modeling: application to plane channel and square duct flows
• Multiscale DeepONet for Nonlinear Operators in Oscillatory Function Spaces for Building Seismic Wave Responses
• I-FENN with Temporal Convolutional Networks: expediting the load-history analysis of non-local gradient damage propagation
• Improved Surrogate Modeling of Fluid Dynamics with Physics-Informed Neural Networks
• Random matrix analysis of deep neural network weight matrices
• Elvet -- a neural network-based differential equation and variational problem solver
• Physics-informed attention-based neural network for solving non-linear partial differential equations
• A multifidelity approach to continual learning for physical systems
• LordNet: An Efficient Neural Network for Learning to Solve Parametric Partial Differential Equations without Simulated Data
• Solving Partial Differential Equations with Point Source Based on Physics-Informed Neural Networks
• Bounded nonlinear forecasts of partially observed geophysical systems with physics-constrained deep learning
• Can physical information aid the generalization ability of Neural Networks for hydraulic modeling?
• Generative prediction of flow fields around an obstacle using the diffusion model
• Finite-difference-informed graph network for solving steady-state incompressible flows on block-structured grids
• LSA-PINN: Linear Boundary Connectivity Loss for Solving PDEs on Complex Geometry
• Cell-average based neural network method for hyperbolic and parabolic partial differential equations
• Multi-Fidelity Machine Learning Applied to Steady Fluid Flows
• Modeling Global Surface Dust Deposition Using Physics-Informed Neural Networks
• Monte Carlo Neural PDE Solver for Learning PDEs via Probabilistic Representation
• Physics-Informed Neural Networks for Transonic Flows around an Airfoil
• Solving 2-D Helmholtz equation in the rectangular, circular, and elliptical domains using neural networks
• Certified machine learning: Rigorous a posteriori error bounds for PDE defined PINNs
• Approximating Families of Sharp Solutions to Fisher's Equation with Physics-Informed Neural Networks
• Inferring parameters and reconstruction of two-dimensional turbulent flows with physics-informed neural networks
• Multivariate Physics-Informed Convolutional Autoencoder for Anomaly Detection in Power Distribution Systems with High Penetration of DERs
• Physics-Informed Neural Networks for Optimal Vaccination Plan in SIR Epidemic Models
• A composable autoencoder-based iterative algorithm for accelerating numerical simulations
• Applying physics-based loss functions to neural networks for improved generalizability in mechanics problems
• A deep neural network approach on solving the linear transport model under diffusive scaling
• Sinc Kolmogorov-Arnold network and its application for solving PDEs with singularities
• Spectral Informed Neural Network: An Efficient and Low-Memory PINN
• Boundary between noise and information applied to filtering neural network weight matrices
• Machine-learning-based simulation of turbulent flows over periodic hills using a hybrid U-Net and Fourier neural operator framework
• Banach neural operator for Navier-Stokes equations
• Bayesian Hidden Physics Models: Uncertainty Quantification for Discovery of Nonlinear Partial Differential Operators from Data
• Neural Networks with Inputs Based on Domain of Dependence and A Converging Sequence for Solving Conservation Laws, Part I: 1D Riemann Problems
• Quantum Physics-Informed Neural Networks for Maxwell's Equations: Circuit Design, "Black Hole" Barren Plateaus Mitigation, and GPU Acceleration
• Modified physics-informed neural network method based on the conservation law constraint and its prediction of optical solitons
• Physics-informed neural networks for non-Newtonian fluid thermo-mechanical problems: an application to rubber calendering process
• Discovery of Quasi-Integrable Equations from traveling-wave data using the Physics-Informed Neural Networks
• Turbulence closure modeling with data-driven techniques: Investigation of generalizable deep neural networks
• A Machine-Learning Method for Time-Dependent Wave Equations over Unbounded Domains
• Flow field tomography with uncertainty quantification using a Bayesian physics-informed neural network
• Machine Learning for Vortex Induced Vibration in Turbulent Flow
• Prediction of acoustic field in 1-D uniform duct with varying mean flow and temperature using neural networks
• Uncertainty quantification and stability of neural operators for prediction of three-dimensional turbulence
• Spatio-Temporal Uncertainty-Modulated Physics-Informed Neural Networks for Solving Hyperbolic Conservation Laws with Strong Shocks
• Finite Difference Nets: A Deep Recurrent Framework for Solving Evolution PDEs
• Predicting Stress in Two-phase Random Materials and Super-Resolution Method for Stress Images by Embedding Physical Information
• Training-free AI for Earth Observation Change Detection using Physics Aware Neuromorphic Networks
• Intrusive deconvolutional neural networks for enhancing PIC/FLIP solutions
• Stability in Training PINNs for Stiff PDEs: Why Initial Conditions Matter
• Physics Informed Convex Artificial Neural Networks (PICANNs) for Optimal Transport based Density Estimation
• Quasi-Random Physics-informed Neural Networks
• Extending deep learning U-Net architecture for predicting unsteady fluid flows in textured microchannels
• How Sparse and How Noisy? Systematic Benchmarking of Inverse Physics-Informed Neural Networks for Manning Friction Estimation in Shallow Water Equations