1 citations · 2 across the 4 of their papers we have counts for
4 papers
Pruning Unrolled Networks (PUN) at Initialization for MRI Reconstruction Improves Generalization
Shijun Liang, Evan Bell, Avrajit Ghosh +1
Deep learning methods are highly effective for many image reconstruction tasks. However, the performance of supervised learned models can degrade when applied to distinct experimen…
Optimal Eye Surgeon: Finding Image Priors through Sparse Generators at Initialization
Avrajit Ghosh, Xitong Zhang, Kenneth K. Sun +3
We introduce Optimal Eye Surgeon (OES), a framework for pruning and training deep image generator networks. Typically, untrained deep convolutional networks, which include image sa…
Towards Understanding Task-agnostic Debiasing Through the Lenses of Intrinsic Bias and Forgetfulness
Guangliang Liu, Milad Afshari, Xitong Zhang +5
While task-agnostic debiasing provides notable generalizability and reduced reliance on downstream data, its impact on language modeling ability and the risk of relearning social b…
Implicit regularization in Heavy-ball momentum accelerated stochastic gradient descent
Avrajit Ghosh, He Lyu, Xitong Zhang +1
It is well known that the finite step-size () in Gradient Descent (GD) implicitly regularizes solutions to flatter minima. A natural question to ask is "Does the momentum parame…