Showing math.OCShow all
3 papers · 1 filter
math.OC2025
Decentralised convex optimisation with probability-proportional-to-size quantization
Dmitrii Pasechniuk, Pavel Dvurechensky, César A. Uribe +1
Communication is one of the bottlenecks of distributed optimisation and learning. To overcome this bottleneck, we propose a novel quantization method that transforms a vector into…
math.OC2024
Nesterov's method of dichotomy via Order Oracle: The problem of optimizing a two-variable function on a square
Boris Chervonenkis, Andrei Krasnov, Alexander Gasnikov +1
The challenges of black box optimization arise due to imprecise responses and limited output information. This article describes new results on optimizing multivariable functions u…
math.OC2022
Effects of momentum scaling for SGD
Dmitry A. Pasechnyuk, Alexander Gasnikov, Martin Takáč
The paper studies the properties of stochastic gradient methods with preconditioning. We focus on momentum updated preconditioners with momentum coefficient . Seeking to explain…