Solving high-dimensional eigenvalue problems using deep neural networks: A diffusion Monte Carlo like approach

Abstract

We propose a new method to solve eigenvalue problems for linear and semilinear second order differential operators in high dimensions based on deep neural networks. The eigenvalue problem is reformulated as a fixed point problem of the semigroup flow induced by the operator, whose solution can be represented by Feynman-Kac formula in terms of forward-backward stochastic differential equations. The method shares a similar spirit with diffusion Monte Carlo but augments a direct approximation to the eigenfunction through neural-network ansatz. The criterion of fixed point provides a natural loss function to search for parameters via optimization. Our approach is able to provide accurate eigenvalue and eigenfunction approximations in several numerical examples, including Fokker-Planck operator and the linear and nonlinear Schrödinger operators in high dimensions.

arXiv comment18 pages, 6 figures, 5 tables

References in corpus (10)

• Adam: A Method for Stochastic Optimization
• Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
• Solving high-dimensional partial differential equations using deep learning
• Deep learning-based numerical methods for high-dimensional parabolic partial differential equations and backward stochastic differential equations
• Continuum variational and diffusion quantum Monte Carlo calculations
• A Constrained Path Monte Carlo Method for Fermion Ground States
• Fermionic neural-network states for ab-initio electronic structure
• Solving Many-Electron Schrödinger Equation Using Deep Neural Networks
• Convergence of the Deep BSDE Method for Coupled FBSDEs
• Spectral Inference Networks: Unifying Deep and Spectral Learning

Cited by in corpus (18)

• Algorithms for Solving High Dimensional PDEs: From Nonlinear Monte Carlo to Machine Learning
• Convergence of the Deep BSDE Method for Coupled FBSDEs
• An overview on deep learning-based approximation methods for partial differential equations
• Actor-Critic Method for High Dimensional Static Hamilton--Jacobi--Bellman Partial Differential Equations based on Neural Networks
• Predicting rare events using neural networks and short-trajectory data
• A new efficient approximation scheme for solving high-dimensional semilinear PDEs: control variate method for Deep BSDE solver
• Convergence to the fixed-node limit in deep variational Monte Carlo
• A Priori Generalization Analysis of the Deep Ritz Method for Solving High Dimensional Elliptic Equations
• A semigroup method for high dimensional elliptic PDEs and eigenvalue problems based on neural networks
• Solving eigenvalue PDEs of metastable diffusion processes using artificial neural networks
• Convergence of Deep Fictitious Play for Stochastic Differential Games
• Learning the random variables in Monte Carlo simulations with stochastic gradient descent: Machine learning for parametric PDEs and financial derivative pricing
• Reproducing Activation Function for Deep Learning
• Solving Elliptic Equations with Brownian Motion: Bias Reduction and Temporal Difference Learning
• Full Configuration Interaction Excited-State Energies in Large Active Spaces from Subspace Iteration with Repeated Random Sparsification
• Random Batch Algorithms for Quantum Monte Carlo simulations
• Generalization Error Estimates of Machine Learning Methods for Solving High Dimensional Schrödinger Eigenvalue Problems
• Neural-Network Quantum States for Periodic Systems in Continuous Space