Universal Transformers

Mostafa Dehghani, Stephan Gouws, Oriol Vinyals +2

Recurrent neural networks (RNNs) sequentially process data by updating their state with each new data point, and have long been the de facto choice for sequence modeling tasks. How…