batch normalization 1deep learning 1generalization 1learning rate 1optimization 1stochastic differential equations 1
From the 1 of 15 linked papers with an AI index.
204 citations · 389 across the 11 of their papers we have counts for
Showing cs.CLShow all
2 papers · 1 filter
cs.CL2020
TextHide: Tackling Data Privacy in Language Understanding Tasks
Yangsibo Huang, Zhao Song, Danqi Chen +2
An unsolved challenge in distributed or federated learning is to effectively mitigate privacy risks without slowing down training or reducing accuracy. In this paper, we propose Te…
cs.CL2020
A Mathematical Exploration of Why Language Models Help Solve Downstream Tasks
Nikunj Saunshi, Sadhika Malladi, Sanjeev Arora
Autoregressive language models, pretrained using large text corpora to do well on next word prediction, have been successful at solving many downstream tasks, even with zero-shot u…