Big Bidirectional Insertion Representations for Documents

Lala Li, William Chan

The Insertion Transformer is well suited for long form text generation due to its parallel generation capabilities, requiring $O({\log }_{2}n)$ generation steps to generate $n$ tokens.…