Efficient Domain Adaptation of Language Models via Adaptive Tokenization

Vin Sachidananda, Jason S. Kessler, Yi-an Lai

Contextual embedding-based language models trained on large data sets, such as BERT and RoBERTa, provide strong performance across a wide range of tasks and are ubiquitous in moder…