A Method for Representing Periodic Functions and Enforcing Exactly Periodic Boundary Conditions with Deep Neural Networks

Abstract

We present a simple and effective method for representing periodic functions and enforcing exactly the periodic boundary conditions for solving differential equations with deep neural networks (DNN). The method stems from some simple properties about function compositions involving periodic functions. It essentially composes a DNN-represented arbitrary function with a set of independent periodic functions with adjustable (training) parameters. We distinguish two types of periodic conditions: those imposing the periodicity requirement on the function and all its derivatives (to infinite order), and those imposing periodicity on the function and its derivatives up to a finite order $k$ ($k⩾0$). The former will be referred to as $C^{\infty }$ periodic conditions, and the latter $C^k$ periodic conditions. We define operations that constitute a $C^{\infty }$ periodic layer and a $C^k$ periodic layer (for any $k⩾0$). A deep neural network with a $C^{\infty }$ (or $C^k$) periodic layer incorporated as the second layer automatically and exactly satisfies the $C^{\infty }$ (or $C^k$) periodic conditions. We present extensive numerical experiments on ordinary and partial differential equations with $C^{\infty }$ and $C^k$ periodic boundary conditions to verify and demonstrate that the proposed method indeed enforces exactly, to the machine accuracy, the periodicity for the DNN solution and its derivatives.

arXiv comment31 pages, 16 figures, 8 tables

References in corpus (10)

• Adam: A Method for Stochastic Optimization
• Artificial Neural Networks for Solving Ordinary and Partial Differential Equations
• DGM: A deep learning algorithm for solving partial differential equations
• An Energy Approach to the Solution of Partial Differential Equations in Computational Mechanics via Machine Learning: Concepts, Implementation and Applications
• A unified deep artificial neural network approach to partial differential equations in complex geometries
• Weak Adversarial Networks for High-dimensional Partial Differential Equations
• A Convective-like Energy-Stable Open Boundary Condition for Simulations of Incompressible Flows
• A pressure correction scheme for generalized form of energy-stable open boundary conditions for incompressible flows
• Physics informed deep learning for computational elastodynamics without labeled data
• Energy-Stable Boundary Conditions Based on a Quadratic Form: Applications to Outflow/Open-Boundary Problems in Incompressible Flows

Cited by in corpus (29)

• Gradient-enhanced physics-informed neural networks for forward and inverse PDE problems
• A comprehensive study of non-adaptive and residual-based adaptive sampling for physics-informed neural networks
• Local Extreme Learning Machines and Domain Decomposition for Solving Linear and Nonlinear Partial Differential Equations
• Residual-based attention in physics-informed neural networks
• A unified scalable framework for causal sweeping strategies for Physics-Informed Neural Networks (PINNs) and their temporal decompositions
• Unveiling the optimization process of Physics Informed Neural Networks: How accurate and competitive can PINNs be?
• Physics-informed data based neural networks for two-dimensional turbulence
• On Computing the Hyperparameter of Extreme Learning Machines: Algorithm and Application to Computational PDEs, and Comparison with Classical and High-Order Finite Elements
• Optimizing a DIscrete Loss (ODIL) to solve forward and inverse problems for partial differential equations using machine learning tools
• Lagrangian PINNs: A causality-conforming solution to failure modes of physics-informed neural networks
• A Modified Batch Intrinsic Plasticity Method for Pre-training the Random Coefficients of Extreme Learning Machines
• An unsupervised latent/output physics-informed convolutional-LSTM network for solving partial differential equations using peridynamic differential operator
• Improved Training of Physics-Informed Neural Networks with Model Ensembles
• CEENs: Causality-enforced evolutional networks for solving time-dependent partial differential equations
• Numerical Approximation of Partial Differential Equations by a Variable Projection Method with Artificial Neural Networks
• A comprehensive and fair comparison of two neural operators (with practical extensions) based on FAIR data
• A Dimension-Augmented Physics-Informed Neural Network (DaPINN) with High Level Accuracy and Efficiency
• A Priori Generalization Analysis of the Deep Ritz Method for Solving High Dimensional Elliptic Equations
• An extrapolation-driven network architecture for physics-informed deep learning
• Rapid Estimation of Left Ventricular Contractility with a Physics-Informed Neural Network Inverse Modeling Approach
• Machine-learning-inspired quantum optimal control of nonadiabatic geometric quantum computation via reverse engineering
• Computing non-equilibrium trajectories by a deep learning approach
• Certified machine learning: Rigorous a posteriori error bounds for PDE defined PINNs
• About optimal loss function for training physics-informed neural networks under respecting causality
• General-relativistic magnetar magnetospheres in 3D with physics-informed neural networks
• Quantum Physics-Informed Neural Networks for Maxwell's Equations: Circuit Design, "Black Hole" Barren Plateaus Mitigation, and GPU Acceleration
• A Physics-Constrained Neural Differential Equation Framework for Data-Driven Snowpack Simulation
• Stability in Training PINNs for Stiff PDEs: Why Initial Conditions Matter
• Neural Network Surrogates for Free Energy Computation of Complex Chemical Systems