Sinc Kolmogorov-Arnold network and its application for solving PDEs with singularities

Abstract

In this paper, we propose to use Sinc interpolation in the context of Kolmogorov-Arnold Networks, neural networks with learnable activation functions, which recently gained attention as alternatives to Multilayer Perceptron. Many different function representations have already been tried, but we show that Sinc interpolation proposes a viable alternative, since it is known in numerical analysis to effectively represent both smooth functions and functions with singularities. This is important not only for function approximation but also for solving the partial differential equations with physics-informed neural networks. Through a series of experiments, we show that SincKANs provide better results in almost all of the examples we have considered.

References in corpus (16)

• Artificial Neural Networks for Solving Ordinary and Partial Differential Equations
• Solving high-dimensional partial differential equations using deep learning
• NSFnets (Navier-Stokes Flow nets): Physics-informed neural networks for the incompressible Navier-Stokes equations
• fPINNs: Fractional Physics-Informed Neural Networks
• Gradient-enhanced physics-informed neural networks for forward and inverse PDE problems
• Kolmogorov Arnold Informed neural network: A physics-informed deep learning framework for solving forward and inverse problems based on Kolmogorov Arnold Networks
• When and why PINNs fail to train: A neural tangent kernel perspective
• PirateNets: Physics-informed Deep Learning with Residual Adaptive Networks
• MIM: A deep mixed residual method for solving high-order partial differential equations
• Can Shallow Neural Networks Beat the Curse of Dimensionality? A mean field training perspective
• Physics-Informed Neural Networks for Quantum Eigenvalue Problems
• A comprehensive and FAIR comparison between MLP and KAN representations for differential equations and operator networks
• MultiAdam: Parameter-wise Scale-invariant Optimizer for Multiscale Training of Physics-informed Neural Networks
• Priori Error Estimate of Deep Mixed Residual Method for Elliptic PDEs
• Physics-informed neural networks for parameter learning of wildfire spreading
• Kolmogorov-Arnold PointNet: Deep learning for prediction of fluid fields on irregular geometries