Efficient Natural Gradient Descent Methods for Large-Scale PDE-Based Optimization Problems

Levon Nurbekyan, Wanzhou Lei, Yunan Yang

We propose efficient numerical schemes for implementing the natural gradient descent (NGD) for a broad range of metric spaces with applications to PDE-based optimization problems.…