most citedAligning the Pretraining and Finetuning Objectives of Language Models

1 citations · 1 across the 1 of their papers we have counts for

collaborators

1 paper

cs.CL2020★ 1 cited

Aligning the Pretraining and Finetuning Objectives of Language Models

Nuo Wang Pierse, Jingwen Lu

We demonstrate that explicitly aligning the pretraining objectives to the finetuning objectives in language model training significantly improves the finetuning task performance an…