Neural Shuffle-Exchange Networks -- Sequence Processing in O(n log n) Time

Kārlis Freivalds, Emīls Ozoliņš, Agris Šostaks

A key requirement in sequence to sequence processing is the modeling of long range dependencies. To this end, a vast majority of the state-of-the-art models use attention mechanism…