You can't pick your neighbors, or can you? When and how to rely on retrieval in the $k$NN-LM

Andrew Drozdov, Shufan Wang, Razieh Rahimi +3

Retrieval-enhanced language models (LMs), which condition their predictions on text retrieved from large external datastores, have recently shown significant perplexity improvement…