Adaptation Approaches for Nearest Neighbor Language Models

Rishabh Bhardwaj, George Polovets, Monica Sunkara

Semi-parametric Nearest Neighbor Language Models ($k$NN-LMs) have produced impressive gains over purely parametric LMs, by leveraging large-scale neighborhood retrieval over extern…