Moonbeam: A MIDI Foundation Model Using Both Absolute and Relative Music Attributes

Zixun Guo, Simon Dixon

Moonbeam is a transformer-based foundation model for symbolic music, pretrained on a large and diverse collection of MIDI data totaling 81.6K hours of music and 18 billion tokens.…