44 citations · 145 across the 18 of their papers we have counts for
Showing 2019Show all
3 papers · 1 filter
cs.LG2019★ 11 cited
Revisiting Landscape Analysis in Deep Neural Networks: Eliminating Decreasing Paths to Infinity
Shiyu Liang, Ruoyu Sun, R. Srikant
Traditional landscape analysis of deep neural networks aims to show that no sub-optimal local minima exist in some appropriate sense. From this, one may be tempted to conclude that…
cs.LG2019★ 3 cited
Sub-Optimal Local Minima Exist for Neural Networks with Almost All Non-Linear Activations
Tian Ding, Dawei Li, Ruoyu Sun
Does over-parameterization eliminate sub-optimal local minima for neural networks? An affirmative answer was given by a classical result in [59] for 1-hidden-layer wide neural netw…
math.OC2019
Understanding Limitation of Two Symmetrized Orders by Worst-case Complexity
Peijun Xiao, Zhisheng Xiao, Ruoyu Sun
Update order is one of the major design choices of block decomposition algorithms. There are at least two classes of deterministic update orders: nonsymmetric (e.g. cyclic order) a…