Audiomer: A Convolutional Transformer For Keyword Spotting

Surya Kant Sahu, Sai Mitheran, Juhi Kamdar +1

Transformers have seen an unprecedented rise in Natural Language Processing and Computer Vision tasks. However, in audio tasks, they are either infeasible to train due to extremely…