Toward Interpretable Music Tagging with Self-Attention

Minz Won, Sanghyuk Chun, Xavier Serra

Self-attention is an attention mechanism that learns a representation by relating different positions in the sequence. The transformer, which is a sequence model solely based on se…