most citedAccelerated Almost-Sure Convergence Rates for Nonconvex Stochastic Gradient Descent using Stochastic Learning Rates

1 citations · 1 across the 2 of their papers we have counts for

collaborators

2 papers

math.OC2021★ 1 cited

Accelerated Almost-Sure Convergence Rates for Nonconvex Stochastic Gradient Descent using Stochastic Learning Rates

Theodoros Mamalis, Dusan Stipanovic, Petros Voulgaris

Large-scale optimization problems require algorithms both effective and efficient. One such popular and proven algorithm is Stochastic Gradient Descent which uses first-order gradi…

math.OC2021

Stochastic Learning Rate Optimization in the Stochastic Approximation and Online Learning Settings

Theodoros Mamalis, Dusan Stipanovic, Petros Voulgaris

In this work, multiplicative stochasticity is applied to the learning rate of stochastic optimization algorithms, giving rise to stochastic learning-rate schemes. In-expectation th…