565 citations · 633 across the 13 of their papers we have counts for
13 papers
When does the student surpass the teacher? Federated Semi-supervised Learning with Teacher-Student EMA
Jessica Zhao, Sayan Ghosh, Akash Bharadwaj +1
Semi-Supervised Learning (SSL) has received extensive attention in the domain of computer vision, leading to development of promising approaches such as FixMatch. In scenarios wher…
Pruning Compact ConvNets for Efficient Inference
Sayan Ghosh, Karthik Prasad, Xiaoliang Dai +4
Neural network pruning is frequently used to compress over-parameterized networks by large amounts, while incurring only marginal drops in generalization performance. However, the…
LaSQuE: Improved Zero-Shot Classification from Explanations Through Quantifier Modeling and Curriculum Learning
Sayan Ghosh, Rakesh R Menon, Shashank Srivastava
A hallmark of human intelligence is the ability to learn new concepts purely from language. Several recent approaches have explored training machine learning models via natural lan…
Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models
Aarohi Srivastava, Abhinav Rastogi, Abhishek Rao +448
Language models demonstrate both quantitative improvement and new qualitative capabilities with increasing scale. Despite their potentially transformative impact, these new capabil…
CLUES: A Benchmark for Learning Classifiers using Natural Language Explanations
Rakesh R Menon, Sayan Ghosh, Shashank Srivastava
Supervised learning has traditionally focused on inductive learning by observing labeled examples of a task. In contrast, humans have the ability to learn new concepts from languag…
Learning to Mediate Disparities Towards Pragmatic Communication
Yuwei Bao, Sayan Ghosh, Joyce Chai
Human communication is a collaborative process. Speakers, on top of conveying their own intent, adjust the content and language expressions by taking the listeners into account, in…
Mapping Language to Programs using Multiple Reward Components with Inverse Reinforcement Learning
Sayan Ghosh, Shashank Srivastava
Mapping natural language instructions to programs that computers can process is a fundamental challenge. Existing approaches focus on likelihood-based training or using reinforceme…
Adversarial Scrubbing of Demographic Information for Text Classification
Somnath Basu Roy Chowdhury, Sayan Ghosh, Yiyuan Li +3
Contextual representations learned by language models can often encode undesirable attributes, like demographic associations of the users, while being trained for an unrelated targ…
Opacus: User-Friendly Differential Privacy Library in PyTorch
Ashkan Yousefpour, Igor Shilov, Alexandre Sablayrolles +9
We introduce Opacus, a free, open-source PyTorch library for training deep learning models with differential privacy (hosted at opacus.ai). Opacus is designed for simplicity, flexi…
ePiC: Employing Proverbs in Context as a Benchmark for Abstract Language Understanding
Sayan Ghosh, Shashank Srivastava
While large language models have shown exciting progress on several NLP benchmarks, evaluating their ability for complex analogical reasoning remains under-explored. Here, we intro…
Detecting Cross-Geographic Biases in Toxicity Modeling on Social Media
Sayan Ghosh, Dylan Baker, David Jurgens +1
Online social media platforms increasingly rely on Natural Language Processing (NLP) techniques to detect abusive content at scale in order to mitigate the harms it causes to their…
Affect-LM: A Neural Language Model for Customizable Affective Text Generation
Sayan Ghosh, Mathieu Chollet, Eugene Laksana +2
Human verbal communication includes affective messages which are conveyed through use of emotionally colored words. There has been a lot of research in this direction but the probl…
Learning Representations of Affect from Speech
Sayan Ghosh, Eugene Laksana, Louis-Philippe Morency +1
There has been a lot of prior work on representation learning for speech recognition applications, but not much emphasis has been given to an investigation of effective representat…