Accelerated Stochastic ExtraGradient: Mixing Hessian and Gradient Similarity to Reduce Communication in Distributed and Federated Learning

Dmitry Bylinkin, Kirill Degtyarev, Aleksandr Beznosikov

Modern realities and trends in learning require more and more generalization ability of models, which leads to an increase in both models and training sample size. It is already di…