Style Locality for Controllable Generation with kNN Language Models

Gilles Nawezi, Lucie Flek, Charles Welch

Recent language models have been improved by the addition of external memory. Nearest neighbor language models retrieve similar contexts to assist in word prediction. The addition…