most citedAdaSplit: Adaptive Trade-offs for Resource-constrained Distributed Deep Learning

14 citations · 17 across the 6 of their papers we have counts for

collaborators

6 papers

cs.CL2022

TaskMix: Data Augmentation for Meta-Learning of Spoken Intent Understanding

Surya Kant Sahu

Meta-Learning has emerged as a research direction to better transfer knowledge from related tasks to unseen but related tasks. However, Meta-Learning requires many training tasks t…

cs.LG2022

Not All Lotteries Are Made Equal

Surya Kant Sahu, Sai Mitheran, Somya Suhans Mahapatra

The Lottery Ticket Hypothesis (LTH) states that for a reasonably sized neural network, a sub-network within the same network yields no less performance than the dense counterpart w…

cs.LG2021★ 14 cited

AdaSplit: Adaptive Trade-offs for Resource-constrained Distributed Deep Learning

Ayush Chopra, Surya Kant Sahu, Abhishek Singh +4

Distributed deep learning frameworks like federated learning (FL) and its variants are enabling personalized experiences across a wide range of web clients and mobile/IoT devices.…

cs.LG2021

Audiomer: A Convolutional Transformer For Keyword Spotting

Surya Kant Sahu, Sai Mitheran, Juhi Kamdar +1

Transformers have seen an unprecedented rise in Natural Language Processing and Computer Vision tasks. However, in audio tasks, they are either infeasible to train due to extremely…

cs.IR2021★ 3 cited

Introducing Self-Attention to Target Attentive Graph Neural Networks

Sai Mitheran, Abhinav Java, Surya Kant Sahu +1

Session-based recommendation systems suggest relevant items to users by modeling user behavior and preferences using short-term anonymous sessions. Existing methods leverage Graph…

cs.LG2021

Rethinking Neural Networks With Benford's Law

Surya Kant Sahu, Abhinav Java, Arshad Shaikh +1

Benford's Law (BL) or the Significant Digit Law defines the probability distribution of the first digit of numerical values in a data sample. This Law is observed in many naturally…