Improving BERT for Symbolic Music Understanding Using Token Denoising and Pianoroll Prediction

Jun-You Wang, Li Su

We propose a pre-trained BERT-like model for symbolic music understanding that achieves competitive performance across a wide range of downstream tasks. To achieve this target, we…