12 citations · 21 across the 5 of their papers we have counts for
5 papers
Auto-Train-Once: Controller Network Guided Automatic Network Pruning from Scratch
Xidong Wu, Shangqian Gao, Zeyu Zhang +5
Current techniques for deep neural network (DNN) pruning often involve intricate multi-step processes that require domain-specific expertise, making their widespread adoption chall…
Asymptotic Escape of Spurious Critical Points on the Low-rank Matrix Manifold
Thomas Y. Hou, Zhenzhen Li, Ziyun Zhang
We show that on the manifold of fixed-rank and symmetric positive semi-definite matrices, the Riemannian gradient descent algorithm almost surely escapes some spurious critical poi…
Fast Global Convergence for Low-rank Matrix Recovery via Riemannian Gradient Descent with Random Initialization
Thomas Y. Hou, Zhenzhen Li, Ziyun Zhang
In this paper, we propose a new global analysis framework for a class of low-rank matrix recovery problems on the Riemannian manifold. We analyze the global behavior for the Rieman…
Analysis of Asymptotic Escape of Strict Saddle Sets in Manifold Optimization
Thomas Y. Hou, Zhenzhen Li, Ziyun Zhang
In this paper, we provide some analysis on the asymptotic escape of strict saddles in manifold optimization using the projected gradient descent (PGD) algorithm. One of our main co…
Towards the optimal construction of a loss function without spurious local minima for solving quadratic equations
Zhenzhen Li, Jian-Feng Cai, Ke Wei
The problem of finding a vector which obeys a set of quadratic equations , , plays an important role in many applications. In this paper we co…