Addressing Distribution Shift at Test Time in Pre-trained Language Models

Ayush Singh, John E. Ortega

State-of-the-art pre-trained language models (PLMs) outperform other models when applied to the majority of language processing tasks. However, PLMs have been found to degrade in p…