Exploring Self-Attention Mechanisms for Speech Separation

Cem Subakan, Mirco Ravanelli, Samuele Cornell +2

Transformers have enabled impressive improvements in deep learning. They often outperform recurrent and convolutional models in many tasks while taking advantage of parallel proces…