68 citations · 160 across the 28 of their papers we have counts for
Showing 2019Show all
2 papers · 1 filter
stat.ML2019★ 1 cited
Exact Convergence Rates of the Neural Tangent Kernel in the Large Depth Limit
Soufiane Hayou, Arnaud Doucet, Judith Rousseau
Recent work by Jacot et al. (2018) has shown that training a neural network using gradient descent in parameter space is related to kernel gradient descent in function space with r…
stat.ML2019★ 68 cited
On the Impact of the Activation Function on Deep Neural Networks Training
Soufiane Hayou, Arnaud Doucet, Judith Rousseau
The weight initialization and the activation function of deep neural networks have a crucial impact on the performance of the training procedure. An inappropriate selection can lea…