activity
20212026
most citedScaling Sparse Fine-Tuning to Large Language Models

1 citations · 2 across the 7 of their papers we have counts for

collaborators
Showing 2023Show all

2 papers · 1 filter

cs.CL2023

Cross-Lingual Transfer with Target Language-Ready Task Adapters

Marinela Parović, Alan Ansell, Ivan Vulić +1

Adapters have emerged as a modular and parameter-efficient approach to (zero-shot) cross-lingual transfer. The established MAD-X framework employs separate language and task adapte…

cs.CL2023

Distilling Efficient Language-Specific Models for Cross-Lingual Transfer

Alan Ansell, Edoardo Maria Ponti, Anna Korhonen +1

Massively multilingual Transformers (MMTs), such as mBERT and XLM-R, are widely used for cross-lingual transfer learning. While these are pretrained to represent hundreds of langua…