Harmonic Representations in Symbolic Music Transformers are Localized and Controllable

Adi Silberschein, Megan Wei, Tamar Rott Shaham

Transformer models trained on symbolic music have become remarkably capable. However, it is yet unclear how they represent music structure, and whether understanding their internal…