3 citations · 4 across the 3 of their papers we have counts for
3 papers
Early Weight Averaging meets High Learning Rates for LLM Pre-training
Sunny Sanyal, Atula Neerkaje, Jean Kaddour +2
Training Large Language Models (LLMs) incurs significant cost; hence, any strategy that accelerates model convergence is helpful. In this paper, we investigate the ability of a sim…
How Much User Context Do We Need? Privacy by Design in Mental Health NLP Application
Ramit Sawhney, Atula Tejaswi Neerkaje, Ivan Habernal +1
Clinical NLP tasks such as mental health assessment from text, must take social constraints into account - the performance maximization must be constrained by the utmost importance…
The Impact of Differential Privacy on Group Disparity Mitigation
Victor Petrén Bach Hansen, Atula Tejaswi Neerkaje, Ramit Sawhney +2
The performance cost of differential privacy has, for some applications, been shown to be higher for minority groups; fairness, conversely, has been shown to disproportionally comp…