Investigating Masking-based Data Generation in Language Models

Ed S. Ma

The current era of natural language processing (NLP) has been defined by the prominence of pre-trained language models since the advent of BERT. A feature of BERT and models with s…