Machine-learning custom-made basis functions for partial differential equations

Abstract

Spectral methods are an important part of scientific computing's arsenal for solving partial differential equations (PDEs). However, their applicability and effectiveness depend crucially on the choice of basis functions used to expand the solution of a PDE. The last decade has seen the emergence of deep learning as a strong contender in providing efficient representations of complex functions. In the current work, we present an approach for combining deep neural networks with spectral methods to solve PDEs. In particular, we use a deep learning technique known as the Deep Operator Network (DeepONet), to identify candidate functions on which to expand the solution of PDEs. We have devised an approach which uses the candidate functions provided by the DeepONet as a starting point to construct a set of functions which have the following properties: i) they constitute a basis, 2) they are orthonormal, and 3) they are hierarchical i.e., akin to Fourier series or orthogonal polynomials. We have exploited the favorable properties of our custom-made basis functions to both study their approximation capability and use them to expand the solution of linear and nonlinear time-dependent PDEs.

arXiv comment35 pages, software used to reach results available upon request, approved for release by Pacific Northwest National Laboratory (PNNL-SA-168281)

References in corpus (12)

• Fourier Neural Operator for Parametric Partial Differential Equations
• hp-VPINNs: Variational Physics-Informed Neural Networks With Domain Decomposition
• Integrating Machine Learning and Multiscale Modeling: Perspectives, Challenges, and Opportunities in the Biological, Biomedical, and Behavioral Sciences
• Variational Physics-Informed Neural Networks For Solving Partial Differential Equations
• Neural Operator: Graph Kernel Network for Partial Differential Equations
• Immersed Boundary Smooth Extension: A high-order method for solving PDE on arbitrary smooth domains using Fourier spectral methods
• Convergence rate of DeepONets for learning operators arising from advection-diffusion equations
• The Smooth Forcing Extension Method: A High-Order Technique for Solving Elliptic Equations on Complex Domains
• Partition of unity networks: deep hp-approximation
• Optimal renormalization of multi-scale systems
• Galerkin Neural Networks: A Framework for Approximating Variational Equations with Error Control
• Probabilistic partition of unity networks: clustering based deep approximation