2 papers
cs.LG2025
SensLI: Sensitivity-Based Layer Insertion for Neural Networks
Leonie Kreis, Evelyn Herberg, Frederik Köhne +2
The training of neural networks requires tedious and often manual tuning of the network architecture. We propose a systematic approach to inserting new layers during the training p…
math.OC2024
Adaptive Step Sizes for Preconditioned Stochastic Gradient Descent
Frederik Köhne, Leonie Kreis, Anton Schiela +1
This paper proposes a novel approach to adaptive step sizes in stochastic gradient descent (SGD) by utilizing quantities that we have identified as numerically traceable -- the Lip…