2.2k citations · 5k across the 31 of their papers we have counts for
Showing 2020Show all
3 papers · 1 filter
cs.CL2020
Syntactic Structure Distillation Pretraining For Bidirectional Encoders
Adhiguna Kuncoro, Lingpeng Kong, Daniel Fried +4
Textual representation learners trained on large amounts of data have achieved notable success on downstream tasks; intriguingly, they have also performed well on challenging tests…
cs.CL2020★ 51 cited
A Call for More Rigor in Unsupervised Cross-lingual Learning
Mikel Artetxe, Sebastian Ruder, Dani Yogatama +2
We review motivations, definition, approaches, and methodology for unsupervised cross-lingual learning and call for a more rigorous position in each of them. An existing rationale…
cs.CL2020★ 4 cited
Modelling Latent Skills for Multitask Language Generation
Kris Cao, Dani Yogatama
We present a generative model for multitask conditional language generation. Our guiding hypothesis is that a shared set of latent skills underlies many disparate language generati…