FastLRNR and Sparse Physics Informed Backpropagation
arXiv:2410.04001 · doi:10.1016/j.rinam.2025.100547
Abstract
We introduce Sparse Physics Informed Backpropagation (SPInProp), a new class of methods for accelerating backpropagation for a specialized neural network architecture called Low Rank Neural Representation (LRNR). The approach exploits the low rank structure within LRNR and constructs a reduced neural network approximation that is much smaller in size. We call the smaller network FastLRNR. We show that backpropagation of FastLRNR can be substituted for that of LRNR, enabling a significant reduction in complexity. We apply SPInProp to a physics informed neural networks framework and demonstrate how the solution of parametrized partial differential equations is accelerated.
10 pages, 3 figures
References in corpus (5)
- The GNAT method for nonlinear model reduction: effective implementation and application to computational fluid dynamics and turbulent flows
- Double Greedy Algorithms: Reduced Basis Methods for Transport Dominated Problems
- Hypernetwork-based Meta-Learning for Low-Rank Physics-Informed Neural Networks
- A Low Rank Neural Representation of Entropy Solutions
- Performance bounds for Reduced Order Models with Application to Parametric Transport