2 papers
cs.LG2025
Sign-SGD via Parameter-Free Optimization
Daniil Medyakov, Sergey Stanko, Gleb Molodtsov +4
Large language models have achieved major advances across domains, yet training them remains extremely resource-intensive. We revisit Sign-SGD, which serves both as a memory-effici…
math.OC2024
Accelerated Methods with Compression for Horizontal and Vertical Federated Learning
Sergey Stanko, Timur Karimullin, Aleksandr Beznosikov +1
Distributed optimization algorithms have emerged as a superior approaches for solving machine learning problems. To accommodate the diverse ways in which data can be stored across…