activity
20182023
most citedEnhancing the Locality and Breaking the Memory Bottleneck of Transformer on Time Series Forecasting

1.1k citations · 1.5k across the 15 of their papers we have counts for

collaborators
Showing 2018Show all

1 paper · 1 filter

cs.LG2018

Towards Understanding Acceleration Tradeoff between Momentum and Asynchrony in Nonconvex Stochastic Optimization

Tianyi Liu, Shiyang Li, Jianping Shi +2

Asynchronous momentum stochastic gradient descent algorithms (Async-MSGD) is one of the most popular algorithms in distributed machine learning. However, its convergence properties…