3 papers
cs.LG2025
SensLI: Sensitivity-Based Layer Insertion for Neural Networks
Leonie Kreis, Evelyn Herberg, Frederik Köhne +2
The training of neural networks requires tedious and often manual tuning of the network architecture. We propose a systematic approach to inserting new layers during the training p…
math.OC2024
Adaptive Step Sizes for Preconditioned Stochastic Gradient Descent
Frederik Köhne, Leonie Kreis, Anton Schiela +1
This paper proposes a novel approach to adaptive step sizes in stochastic gradient descent (SGD) by utilizing quantities that we have identified as numerically traceable -- the Lip…
math.FA2024
Nonlinear Fenchel Conjugates
Anton Schiela, Roland Herzog, Ronny Bergmann
The classical concept of Fenchel conjugation is tailored to extended real-valued functions defined on linear spaces. In this paper we generalize this concept to functions defined o…