most citedFrobenius-Type Norms and Inner Products of Matrices and Linear Maps with Applications to Neural Network Training

1 citations · 1 across the 4 of their papers we have counts for

collaborators
Showing math.OCShow all

1 paper · 1 filter

math.OC2023

Adaptive Step Sizes for Preconditioned Stochastic Gradient Descent

Frederik Köhne, Leonie Kreis, Anton Schiela +1

This paper proposes a novel approach to adaptive step sizes in stochastic gradient descent (SGD) by utilizing quantities that we have identified as numerically traceable -- the Lip…