144 citations · 153 across the 3 of their papers we have counts for
3 papers
Parameter-Efficient Transfer Learning for NLP
Neil Houlsby, Andrei Giurgiu, Stanislaw Jastrzebski +5
Fine-tuning large pre-trained models is an effective transfer mechanism in NLP. However, in the presence of many downstream tasks, fine-tuning is parameter inefficient: an entire n…
Statistical Estimation: From Denoising to Sparse Regression and Hidden Cliques
Eric W. Tramel, Santhosh Kumar, Andrei Giurgiu +1
These notes review six lectures given by Prof. Andrea Montanari on the topic of statistical estimation for linear models. The first two lectures cover the principles of signal reco…
Spatial Coupling as a Proof Technique
Andrei Giurgiu, Nicolas Macris, Rüdiger Urbanke
The aim of this paper is to show that spatial coupling can be viewed not only as a means to build better graphical models, but also as a tool to better understand uncoupled models.…