activity
20152023
most citedAnalysis and Implementation of an Asynchronous Optimization Algorithm for the Parameter Server

29 citations · 59 across the 20 of their papers we have counts for

collaborators
Showing 2021 · math.OCShow all

5 papers · 2 filters

math.OC2021★ 1 cited

A Fast and Accurate Splitting Method for Optimal Transport: Analysis and Implementation

Vien V. Mai, Jacob Lindbäck, Mikael Johansson

We develop a fast and reliable method for solving large-scale optimal transport (OT) problems at an unprecedented combination of speed and accuracy. Built on the celebrated Douglas…

math.OC2021★ 1 cited

Asynchronous Iterations in Optimization: New Sequence Results and Sharper Algorithmic Guarantees

Hamid Reza Feyzmahdavian, Mikael Johansson

We introduce novel convergence results for asynchronous iterations that appear in the analysis of parallel and distributed optimization algorithms. The results are simple to apply…

math.OC2021

A New Family of Feasible Methods for Distributed Resource Allocation

Xuyang Wu, Sindri Magnusson, Mikael Johansson

Distributed resource allocation is a central task in network systems such as smart grids, water distribution networks, and urban transportation systems. When solving such problems…

math.OC2021★ 4 cited

On the Convergence of Step Decay Step-Size for Stochastic Optimization

Xiaoyu Wang, Sindri Magnússon, Mikael Johansson

The convergence of stochastic gradient descent is highly dependent on the step-size, especially on non-convex problems such as neural network training. Step decay step-size schedul…

math.OC2021

Stability and Convergence of Stochastic Gradient Clipping: Beyond Lipschitz Continuity and Smoothness

Vien V. Mai, Mikael Johansson

Stochastic gradient algorithms are often unstable when applied to functions that do not have Lipschitz-continuous and/or bounded gradients. Gradient clipping is a simple and effect…