Overcoming the curse of dimensionality for some Hamilton--Jacobi partial differential equations via neural network architectures
arXiv:1910.09045
Abstract
We propose new and original mathematical connections between Hamilton-Jacobi (HJ) partial differential equations (PDEs) with initial data and neural network architectures. Specifically, we prove that some classes of neural networks correspond to representation formulas of HJ PDE solutions whose Hamiltonians and initial data are obtained from the parameters of the neural networks. These results do not rely on universal approximation properties of neural networks; rather, our results show that some classes of neural network architectures naturally encode the physics contained in some HJ PDEs. Our results naturally yield efficient neural network-based methods for evaluating solutions of some HJ PDEs in high dimension without using grids or numerical approximations. We also present some numerical results for solving some inverse problems involving HJ PDEs using our proposed architectures.
arXiv comment44 pages, 9 figures
References in corpus (29)
- Deep Learning in Neural Networks: An Overview
- DGM: A deep learning algorithm for solving partial differential equations
- Solving high-dimensional partial differential equations using deep learning
- fPINNs: Fractional Physics-Informed Neural Networks
- Physics Informed Deep Learning (Part I): Data-driven Solutions of Nonlinear Partial Differential Equations
- Deep learning-based numerical methods for high-dimensional parabolic partial differential equations and backward stochastic differential equations
- A composite neural network that learns from multi-fidelity data: Application to function approximation and inverse PDE problems
- A unified deep artificial neural network approach to partial differential equations in complex geometries
- PPINN: Parareal Physics-Informed Neural Network for time-dependent PDEs
- PDE-Net 2.0: Learning PDEs from Data with A Numeric-Symbolic Hybrid Deep Network
- Quantifying total uncertainty in physics-informed neural networks for solving forward and inverse stochastic problems
- Adversarial Uncertainty Quantification in Physics-Informed Neural Networks
- Machine learning approximation algorithms for high-dimensional fully nonlinear partial differential equations and second-order backward stochastic differential equations
- Solving Many-Electron Schrödinger Equation Using Deep Neural Networks
- PDE-Net: Learning PDEs from Data
- Deep learning observables in computational fluid dynamics
- Deep splitting method for parabolic PDEs
- The max-plus finite element method for solving deterministic optimal control problems: basic properties and convergence analysis
- Deep neural networks algorithms for stochastic control problems on finite horizon: convergence analysis
- Deep Learning the Physics of Transport Phenomena
- Commuting Hamiltonians and multi-time Hamilton-Jacobi equations
- Curse of dimensionality reduction in max-plus based approximation methods: theoretical estimates and improved pruning algorithms
- Perspectives on characteristics based curse-of-dimensionality-free numerical approaches for solving Hamilton-Jacobi equations
- Learning Neural PDE Solvers with Convergence Guarantees
- A Discussion on Solving Partial Differential Equations using Neural Networks
- Rectified deep neural networks overcome the curse of dimensionality for nonsmooth value functions in zero-sum games of nonlinear stiff systems
- A new scalable algorithm for computational optimal control under uncertainty
- Using Neural Networks to Compute Approximate and Guaranteed Feasible Hamilton-Jacobi-Bellman PDE Solutions
- Study on a Poisson's Equation Solver Based On Deep Learning Technique