1 citations · 1 across the 4 of their papers we have counts for
Showing 2024 · math.OCShow all
2 papers · 2 filters
math.OC2024
Analysis of a Class of Stochastic Component-Wise Soft-Clipping Schemes
Måns Williamson, Monika Eisenmann, Tony Stillfjord
Choosing the optimization algorithm that performs best on a given machine learning problem is often delicate, and there is no guarantee that current state-of-the-art algorithms wil…
math.OC2024
Almost sure convergence of stochastic Hamiltonian descent methods
Måns Williamson, Tony Stillfjord
Gradient normalization and soft clipping are two popular techniques for tackling instability issues and improving convergence of stochastic gradient descent (SGD) with momentum. In…