Continuous Active Learning Using Pretrained Transformers

Nima Sadri, Gordon V. Cormack

Pre-trained and fine-tuned transformer models like BERT and T5 have improved the state of the art in ad-hoc retrieval and question-answering, but not as yet in high-recall informat…