An unsupervised latent/output physics-informed convolutional-LSTM network for solving partial differential equations using peridynamic differential operator

Abstract

This study presents a novel unsupervised convolutional Neural Network (NN) architecture with nonlocal interactions for solving Partial Differential Equations (PDEs). The nonlocal Peridynamic Differential Operator (PDDO) is employed as a convolutional filter for evaluating derivatives the field variable. The NN captures the time-dynamics in smaller latent space through encoder-decoder layers with a Convolutional Long-short Term Memory (ConvLSTM) layer between them. The ConvLSTM architecture is modified by employing a novel activation function to improve the predictive capability of the learning architecture for physics with periodic behavior. The physics is invoked in the form of governing equations at the output of the NN and in the latent (reduced) space. By considering a few benchmark PDEs, we demonstrate the training performance and extrapolation capability of this novel NN architecture by comparing against Physics Informed Neural Networks (PINN) type solvers. It is more capable of extrapolating the solution for future timesteps than the other existing architectures.

arXiv comment23 pages, 15 figures, submitted to Computer Methods in Applied Mechanics and Engineering

References in corpus (25)

• Adam: A Method for Stochastic Optimization
• Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcasting
• LSTM: A Search Space Odyssey
• DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operators
• Artificial Neural Networks for Solving Ordinary and Partial Differential Equations
• Solving high-dimensional partial differential equations using deep learning
• NSFnets (Navier-Stokes Flow nets): Physics-informed neural networks for the incompressible Navier-Stokes equations
• Adaptive activation functions accelerate convergence in deep and physics-informed neural networks
• On the eigenvector bias of Fourier feature networks: From regression to solving multi-scale PDEs with physics-informed neural networks
• Physics-informed neural networks for inverse problems in nano-optics and metamaterials
• A unified deep artificial neural network approach to partial differential equations in complex geometries
• PhyGeoNet: Physics-Informed Geometry-Adaptive Convolutional Neural Networks for Solving Parameterized Steady-State PDEs on Irregular Domain
• Physics-Informed Multi-LSTM Networks for Metamodeling of Nonlinear Structures
• SciANN: A Keras/Tensorflow wrapper for scientific computations and physics-informed deep learning using artificial neural networks
• A physics-informed variational DeepONet for predicting the crack path in brittle materials
• Modeling the Dynamics of PDE Systems with Physics-Constrained Deep Auto-Regressive Networks
• PhyCRNet: Physics-informed Convolutional-Recurrent Network for Solving Spatiotemporal PDEs
• A Method for Representing Periodic Functions and Enforcing Exactly Periodic Boundary Conditions with Deep Neural Networks
• A nonlocal physics-informed deep learning framework using the peridynamic differential operator
• When Do Extended Physics-Informed Neural Networks (XPINNs) Improve Generalization?
• Self-Adaptive Physics-Informed Neural Networks using a Soft Attention Mechanism
• A physics-informed neural network for quantifying the microstructure properties of polycrystalline Nickel using ultrasound data
• Multi-fidelity surrogate modeling using long short-term memory networks
• A deep learning framework for solution and discovery in solid mechanics
• Neural Networks Fail to Learn Periodic Functions and How to Fix It