17 citations · 65 across the 7 of their papers we have counts for
3 papers · 1 filter
Efficient and Private Federated Learning with Partially Trainable Networks
Hakim Sidahmed, Zheng Xu, Ankush Garg +2
Federated learning is used for decentralized training of machine learning models on a large number (millions) of edge mobile devices. It is challenging because mobile devices often…
A Loss Curvature Perspective on Training Instability in Deep Learning
Justin Gilmer, Behrooz Ghorbani, Ankush Garg +6
In this work, we study the evolution of the loss Hessian across many classification tasks in order to understand the effect the curvature of the loss has on the training dynamics.…
Echo State Speech Recognition
Harsh Shrivastava, Ankush Garg, Yuan Cao +2
We propose automatic speech recognition (ASR) models inspired by echo state network (ESN), in which a subset of recurrent neural networks (RNN) layers in the models are randomly in…