243 citations · 392 across the 23 of their papers we have counts for
Showing 2022Show all
2 papers · 1 filter
math.OC2022★ 5 cited
On the Lower Bound of Minimizing Polyak-Łojasiewicz Functions
Pengyun Yue, Cong Fang, Zhouchen Lin
Polyak-Łojasiewicz (PL) [Polyak, 1963] condition is a weaker condition than the strong convexity but suffices to ensure a global convergence for the Gradient Descent algorithm. In…
cs.LG2022
A Roadmap for Big Model
Sha Yuan, Hanyu Zhao, Shuai Zhao +97
With the rapid development of deep learning, training Big Models (BMs) for multiple downstream tasks becomes a popular paradigm. Researchers have achieved various outcomes in the c…