Condenser: a Pre-training Architecture for Dense Retrieval

Luyu Gao, Jamie Callan

Pre-trained Transformer language models (LM) have become go-to text representation encoders. Prior research fine-tunes deep LMs to encode text sequences such as sentences and passa…