Analytical derivatives of Neural Networks
arXiv:2105.02737 · doi:10.1016/j.cpc.2021.108169
Abstract
We propose a simple recursive algorithm that allows the computation of the first- and second-order derivatives with respect to the inputs of an arbitrary deep feed forward neural network (DFNN). The algorithm naturally incorporates the derivatives with respect to the network parameters. To test the algorithm, we apply it to the study of the quantum mechanical variational problem for few cases of simple potentials, modeling the ground-state wave function in terms of a DFNN.
arXiv comment12 pages, 7 figures
References in corpus (10)
- Adam: A Method for Stochastic Optimization
- Artificial Neural Networks for Solving Ordinary and Partial Differential Equations
- DGM: A deep learning algorithm for solving partial differential equations
- Physics Informed Deep Learning (Part I): Data-driven Solutions of Nonlinear Partial Differential Equations
- Physics Informed Deep Learning (Part II): Data-driven Discovery of Nonlinear Partial Differential Equations
- Variational Physics-Informed Neural Networks For Solving Partial Differential Equations
- Artificial Neural Network Methods in Quantum Mechanics
- A Discussion on Solving Partial Differential Equations using Neural Networks
- Parton distribution functions
- On the derivatives of feed-forward neural networks