Adaptive Training of Grid-Dependent Physics-Informed Kolmogorov-Arnold Networks

Abstract

Physics-Informed Neural Networks (PINNs) have emerged as a robust framework for solving Partial Differential Equations (PDEs) by approximating their solutions via neural networks and imposing physics-based constraints on the loss function. Traditionally, Multilayer Perceptrons (MLPs) have been the neural network of choice, with significant progress made in optimizing their training. Recently, Kolmogorov-Arnold Networks (KANs) were introduced as a viable alternative, with the potential of offering better interpretability and efficiency while requiring fewer parameters. In this paper, we present a fast JAX-based implementation of grid-dependent Physics-Informed Kolmogorov-Arnold Networks (PIKANs) for solving PDEs, achieving up to 84 times faster training times than the original KAN implementation. We propose an adaptive training scheme for PIKANs, introducing an adaptive state transition technique to avoid loss function peaks between grid extensions, and a methodology for designing PIKANs with alternative basis functions. Through comparative experiments, we demonstrate that the adaptive features significantly enhance solution accuracy, decreasing the L^2 error relative to the reference solution by up to 43.02%. For the studied PDEs, our methodology approaches or surpasses the results obtained from architectures that utilize up to 8.5 times more parameters, highlighting the potential of adaptive, grid-dependent PIKANs as a superior alternative in scientific and engineering applications.

References in corpus (14)

• NSFnets (Navier-Stokes Flow nets): Physics-informed neural networks for the incompressible Navier-Stokes equations
• Adaptive activation functions accelerate convergence in deep and physics-informed neural networks
• Surrogate Modeling for Fluid Flows Based on Physics-Constrained Deep Learning Without Simulation Data
• Physics-Constrained Deep Learning for High-dimensional Surrogate Modeling and Uncertainty Quantification without Labeled Data
• Gradient-enhanced physics-informed neural networks for forward and inverse PDE problems
• A comprehensive study of non-adaptive and residual-based adaptive sampling for physics-informed neural networks
• Physics-Informed Multi-LSTM Networks for Metamodeling of Nonlinear Structures
• Self-adaptive loss balanced Physics-informed neural networks for the incompressible Navier-Stokes equations
• Finite Basis Physics-Informed Neural Networks (FBPINNs): a scalable domain decomposition approach for solving differential equations
• Efficient training of physics-informed neural networks via importance sampling
• Residual-based attention in physics-informed neural networks
• Physics-Informed Neural Networks for AC Optimal Power Flow
• KANQAS: Kolmogorov-Arnold Network for Quantum Architecture Search
• Chebyshev Polynomial-Based Kolmogorov-Arnold Networks: An Efficient Architecture for Nonlinear Function Approximation

Cited by in corpus (3)

• A Practitioner's Guide to Kolmogorov-Arnold Networks
• Explainable fault and severity classification for rolling element bearings using Kolmogorov-Arnold networks
• Training Deep Physics-Informed Kolmogorov-Arnold Networks