26 citations · 44 across the 4 of their papers we have counts for
4 papers · 1 filter
DropKAN: Regularizing KANs by masking post-activations
Mohammed Ghaith Altarabichi
We propose DropKAN (Dropout Kolmogorov-Arnold Networks) a regularization method that prevents co-adaptation of activation function weights in Kolmogorov-Arnold Networks (KANs). Dro…
Rethinking the Function of Neurons in KANs
Mohammed Ghaith Altarabichi
The neurons of Kolmogorov-Arnold Networks (KANs) perform a simple summation motivated by the Kolmogorov-Arnold representation theorem, which asserts that sum is the only fundamenta…
Rolling the dice for better deep learning performance: A study of randomness techniques in deep neural networks
Mohammed Ghaith Altarabichi, Sławomir Nowaczyk, Sepideh Pashami +2
This paper investigates how various randomization techniques impact Deep Neural Networks (DNNs). Randomization, like weight noise and dropout, aids in reducing overfitting and enha…
Surrogate-Assisted Genetic Algorithm for Wrapper Feature Selection
Mohammed Ghaith Altarabichi, Sławomir Nowaczyk, Sepideh Pashami +1
Feature selection is an intractable problem, therefore practical algorithms often trade off the solution accuracy against the computation time. In this paper, we propose a novel mu…