91 citations · 113 across the 41 of their papers we have counts for
3 papers · 1 filter
Doubly Adaptive Scaled Algorithm for Machine Learning Using Second-Order Information
Majid Jahani, Sergey Rusakov, Zheng Shi +3
We present a novel adaptive optimization algorithm for large-scale machine learning problems. Equipped with a low-cost estimate of local curvature and Lipschitz smoothness, our met…
Decentralized Personalized Federated Learning for Min-Max Problems
Ekaterina Borodich, Aleksandr Beznosikov, Abdurakhmon Sadiev +4
Personalized Federated Learning (PFL) has witnessed remarkable advancements, enabling the development of innovative machine learning applications that preserve the privacy of train…
AI-SARAH: Adaptive and Implicit Stochastic Recursive Gradient Methods
Zheng Shi, Abdurakhmon Sadiev, Nicolas Loizou +2
We present AI-SARAH, a practical variant of SARAH. As a variant of SARAH, this algorithm employs the stochastic recursive gradient yet adjusts step-size based on local geometry. AI…