Online Transformers with Spiking Neurons for Fast Prosthetic Hand Control

Nathan Leroux, Jan Finkbeiner, Emre Neftci

Transformers are state-of-the-art networks for most sequence processing tasks. However, the self-attention mechanism often used in Transformers requires large time windows for each…