4 citations · 5 across the 2 of their papers we have counts for
3 papers
cs.CL2022★ 4 cited
ED2LM: Encoder-Decoder to Language Model for Faster Document Re-ranking Inference
Kai Hui, Honglei Zhuang, Tao Chen +8
State-of-the-art neural models typically encode document-query pairs using cross-attention for re-ranking. To this end, models generally utilize an encoder-only (like BERT) paradig…
cs.CL2020
Neural Passage Retrieval with Improved Negative Contrast
Jing Lu, Gustavo Hernandez Abrego, Ji Ma +2
In this paper we explore the effects of negative sampling in dual encoder models used to retrieve passages for automatic question answering. We explore four negative sampling strat…
cs.CL2020★ 1 cited
Aligning the Pretraining and Finetuning Objectives of Language Models
Nuo Wang Pierse, Jingwen Lu
We demonstrate that explicitly aligning the pretraining objectives to the finetuning objectives in language model training significantly improves the finetuning task performance an…