9 citations · 13 across the 5 of their papers we have counts for
5 papers
Implicit regularization in Heavy-ball momentum accelerated stochastic gradient descent
Avrajit Ghosh, He Lyu, Xitong Zhang +1
It is well known that the finite step-size () in Gradient Descent (GD) implicitly regularizes solutions to flatter minima. A natural question to ask is "Does the momentum parame…
Perturbation of invariant subspaces for ill-conditioned eigensystem
He Lyu, Rongrong Wang
Given a diagonalizable matrix , we study the stability of its invariant subspaces when its matrix of eigenvectors is ill-conditioned. Let be some invariant subsp…
An exact formula for matrix perturbation analysis and its applications
He Lyu, Rongrong Wang
In this paper, we establish a useful set of formulae for the distance between the original and the perturbed singular subspaces. These formulae explicitly show that how the…
Sigma Delta quantization for images
He Lyu, Rongrong Wang
In signal quantization, it is well-known that introducing adaptivity to quantization schemes can improve their stability and accuracy in quantizing bandlimited signals. However, ad…
Manifold Denoising by Nonlinear Robust Principal Component Analysis
He Lyu, Ningyu Sha, Shuyang Qin +3
This paper extends robust principal component analysis (RPCA) to nonlinear manifolds. Suppose that the observed data matrix is the sum of a sparse component and a component drawn f…