N-Grammer: Augmenting Transformers with latent n-grams

Aurko Roy, Rohan Anil, Guangda Lai +13

Transformer models have recently emerged as one of the foundational models in natural language processing, and as a byproduct, there is significant recent interest and investment i…