Large Dual Encoders Are Generalizable Retrievers

Jianmo Ni, Chen Qu, Jing Lu +8

It has been shown that dual encoders trained on one domain often fail to generalize to other domains for retrieval tasks. One widespread belief is that the bottleneck layer of a du…