3 citations · 3 across the 2 of their papers we have counts for
2 papers
cs.CL2023
What is Lost in Knowledge Distillation?
Manas Mohanty, Tanya Roosta, Peyman Passban
Deep neural networks (DNNs) have improved NLP tasks significantly, but training and maintaining such networks could be costly. Model compression techniques, such as, knowledge dist…
cs.CL2021★ 3 cited
Communication-Efficient Federated Learning for Neural Machine Translation
Tanya Roosta, Peyman Passban, Ankit Chadha
Training neural machine translation (NMT) models in federated learning (FL) settings could be inefficient both computationally and communication-wise, due to the large size of tran…