Near-Optimal Non-Convex Stochastic Optimization under Generalized Smoothness

Zijian Liu, Srikanth Jagabathula, Zhengyuan Zhou

The generalized smooth condition, $(L_0,L_1)$-smoothness, has triggered people's interest since it is more realistic in many optimization problems shown by both empirical and t…