Analysis of a Class of Stochastic Component-Wise Soft-Clipping Schemes

Måns Williamson, Monika Eisenmann, Tony Stillfjord

Choosing the optimization algorithm that performs best on a given machine learning problem is often delicate, and there is no guarantee that current state-of-the-art algorithms wil…