7 papers
From Non-Convex Self-Concordant Regularization to Scalable Quasi-Newton Training of PINNs
Chenhao Si, Kang An, Shiqian Ma +1
Physics-informed neural networks (PINNs) often require high-accuracy quasi-Newton refinement to obtain reliable partial differential equation solutions, but their residual objectiv…
Newton Method for Fixed-Support Doubly Entropic Wasserstein Barycenter
Jianting Pan, Sirong Dai, Lei Yang +3
We study the fixed-support doubly regularized Wasserstein barycenter problem. Using the semi-dual formulation of entropic optimal transport, we reformulate the problem as a smooth,…
Inexact Bregman Sparse Newton Method for Efficient Optimal Transport
Jianting Pan, Ji'an Li, Ming Yan
Computing exact Optimal Transport (OT) distances for large-scale datasets is computationally prohibitive. While entropy-regularized alternatives offer speed, they sacrifice precisi…
Improving Discrete Optimisation Via Decoupled Straight-Through Estimator
Rushi Shah, Mingyuan Yan, Michael Curtis Mozer +1
The Straight-Through Estimator (STE) is the dominant method for training neural networks with discrete variables, enabling gradient-based optimisation by routing gradients through…
AutoBalance: An Automatic Balancing Framework for Training Physics-Informed Neural Networks
Kang An, Chenhao Si, Ming Yan +1
Physics-Informed Neural Networks (PINNs) provide a powerful and general framework for solving Partial Differential Equations (PDEs) by embedding physical laws into loss functions.…
Convolution-weighting method for the physics-informed neural network: A Primal-Dual Optimization Perspective
Chenhao Si, Ming Yan
Physics-informed neural networks (PINNs) are extensively employed to solve partial differential equations (PDEs) by ensuring that the outputs and gradients of deep learning models…