Should attention be all we need? The epistemic and ethical implications of unification in machine learning

Nic Fishman, Leif Hancox-Li

"Attention is all you need" has become a fundamental precept in machine learning research. Originally designed for machine translation, transformers and the attention mechanisms th…