2 papers
cs.LG2023
Difference-Masking: Choosing What to Mask in Continued Pretraining
Alex Wilf, Syeda Nahida Akter, Leena Mathur +5
The self-supervised objective of masking-and-predicting has led to promising performance gains on a variety of downstream tasks. However, while most approaches randomly mask tokens…
cs.CL2023
Using Implicit Feedback to Improve Question Generation
Hugo Rodrigues, Eric Nyberg, Luisa Coheur
Question Generation (QG) is a task of Natural Language Processing (NLP) that aims at automatically generating questions from text. Many applications can benefit from automatically…