28 citations · 39 across the 4 of their papers we have counts for
Showing cs.LGShow all
2 papers · 1 filter
cs.LG2019★ 7 cited
The State of Knowledge Distillation for Classification
Fabian Ruffy, Karanbir Chahal
We survey various knowledge distillation (KD) strategies for simple classification tasks and implement a set of techniques that claim state-of-the-art accuracy. Our experiments usi…
cs.LG2018
A Hitchhiker's Guide On Distributed Training of Deep Neural Networks
Karanbir Chahal, Manraj Singh Grover, Kuntal Dey
Deep learning has led to tremendous advancements in the field of Artificial Intelligence. One caveat however is the substantial amount of compute needed to train these deep learnin…