3 citations · 3 across the 2 of their papers we have counts for
2 papers
cs.LG2024★ 3 cited
New logarithmic step size for stochastic gradient descent
M. Soheil Shamaee, S. Fathi Hafshejani, Z. Saeidian
In this paper, we propose a novel warm restart technique using a new logarithmic step size for the stochastic gradient descent (SGD) approach. For smooth and non-convex functions,…
cs.LG2023
Modified Step Size for Enhanced Stochastic Gradient Descent: Convergence and Experiments
M. Soheil Shamaee, S. Fathi Hafshejani
This paper introduces a novel approach to enhance the performance of the stochastic gradient descent (SGD) algorithm by incorporating a modified decay step size based on $\frac{1}{…