160 citations · 168 across the 3 of their papers we have counts for
3 papers
Insertion-Deletion Transformer
Laura Ruis, Mitchell Stern, Julia Proskurnia +1
We propose the Insertion-Deletion Transformer, a novel transformer-based neural architecture and training method for sequence generation. The model consists of two phases that are…
An Empirical Study of Generation Order for Machine Translation
William Chan, Mitchell Stern, Jamie Kiros +1
In this work, we present an empirical study of generation order for machine translation. Building on recent advances in insertion-based modeling, we first introduce a soft order-re…
Insertion Transformer: Flexible Sequence Generation via Insertion Operations
Mitchell Stern, William Chan, Jamie Kiros +1
We present the Insertion Transformer, an iterative, partially autoregressive model for sequence generation based on insertion operations. Unlike typical autoregressive models which…