3 citations · 11 across the 13 of their papers we have counts for
3 papers · 1 filter
No learning rates needed: Introducing SALSA -- Stable Armijo Line Search Adaptation
Philip Kenneweg, Tristan Kenneweg, Fabian Fumagalli +1
In recent studies, line search methods have been demonstrated to significantly enhance the performance of conventional stochastic gradient descent techniques across various dataset…
Improving Line Search Methods for Large Scale Neural Network Training
Philip Kenneweg, Tristan Kenneweg, Barbara Hammer
In recent studies, line search methods have shown significant improvements in the performance of traditional stochastic gradient descent techniques, eliminating the need for a spec…
Faster Convergence for Transformer Fine-tuning with Line Search Methods
Philip Kenneweg, Leonardo Galli, Tristan Kenneweg +1
Recent works have shown that line search methods greatly increase performance of traditional stochastic gradient descent methods on a variety of datasets and architectures [1], [2]…