5 citations · 14 across the 5 of their papers we have counts for
Showing 2022Show all
2 papers · 1 filter
cs.LG2022★ 3 cited
Random initialisations performing above chance and how to find them
Frederik Benzing, Simon Schug, Robert Meier +5
Neural networks trained with stochastic gradient descent (SGD) starting from different random initialisations typically find functionally very similar solutions, raising the questi…
cs.LG2022★ 1 cited
Gradient Descent on Neurons and its Link to Approximate Second-Order Optimization
Frederik Benzing
Second-order optimizers are thought to hold the potential to speed up neural network training, but due to the enormous size of the curvature matrix, they typically require approxim…