AccoMontage: Accompaniment Arrangement via Phrase Selection and Style Transfer

Abstract

Accompaniment arrangement is a difficult music generation task involving intertwined constraints of melody, harmony, texture, and music structure. Existing models are not yet able to capture all these constraints effectively, especially for long-term music generation. To address this problem, we propose AccoMontage, an accompaniment arrangement system for whole pieces of music through unifying phrase selection and neural style transfer. We focus on generating piano accompaniments for folk/pop songs based on a lead sheet (i.e., melody with chord progression). Specifically, AccoMontage first retrieves phrase montages from a database while recombining them structurally using dynamic programming. Second, chords of the retrieved phrases are manipulated to match the lead sheet via style transfer. Lastly, the system offers controls over the generation process. In contrast to pure learning-based approaches, AccoMontage introduces a novel hybrid pathway, in which rule-based optimization and deep learning are both leveraged to complement each other for high-quality generation. Experiments show that our model generates well-structured accompaniment with delicate texture, significantly outperforming the baselines.

Accepted by ISMIR 2021

References in corpus (12)

• MidiNet: A Convolutional Generative Adversarial Network for Symbolic-domain Music Generation
• MuseGAN: Multi-track Sequential Generative Adversarial Networks for Symbolic Music Generation and Accompaniment
• Jukebox: A Generative Model for Music
• POP909: A Pop-song Dataset for Music Arrangement Generation
• A Unit Selection Methodology for Music Generation Using Deep Neural Networks
• Chord Generation from Symbolic Melody Using BLSTM Networks
• Deep Music Analogy Via Latent Representation Disentanglement
• Music Style Transfer: A Position Paper
• PIANOTREE VAE: Structured Representation Learning for Polyphonic Music
• Learning Interpretable Representation for Controllable Polyphonic Music Generation
• Continuous Melody Generation via Disentangled Short-Term Representations and Structural Conditions
• Automatic Analysis and Influence of Hierarchical Structure on Melody, Rhythm and Harmony in Popular Music