Enabling Language Models to Fill in the Blanks

Chris Donahue, Mina Lee, Percy Liang

We present a simple approach for text infilling, the task of predicting missing spans of text at any position in a document. While infilling could enable rich functionality especia…