Imposing higher-level Structure in Polyphonic Music Generation using Convolutional Restricted Boltzmann Machines and Constraints

Abstract

We introduce a method for imposing higher-level structure on generated, polyphonic music. A Convolutional Restricted Boltzmann Machine (C-RBM) as a generative model is combined with gradient descent constraint optimisation to provide further control over the generation process. Among other things, this allows for the use of a "template" piece, from which some structural properties can be extracted, and transferred as constraints to the newly generated material. The sampling process is guided with Simulated Annealing to avoid local optima, and to find solutions that both satisfy the constraints, and are relatively stable with respect to the C-RBM. Results show that with this approach it is possible to control the higher-level self-similarity structure, the meter, and the tonal properties of the resulting musical piece, while preserving its local musical coherence.

31 pages, 11 figures

References in corpus (4)

• Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translation
• On the Properties of Neural Machine Translation: Encoder-Decoder Approaches
• Modeling Temporal Dependencies in High-Dimensional Sequences: Application to Polyphonic Music Generation and Transcription
• DeepBach: a Steerable Model for Bach Chorales Generation

Cited by in corpus (13)

• A Comprehensive Survey on Deep Music Generation: Multi-level Representations, Algorithms, Evaluations, and Future Directions
• MorpheuS: generating structured music with constrained patterns and tension
• Convolutional Generative Adversarial Networks with Binary Neurons for Polyphonic Music Generation
• The Effect of Explicit Structure Encoding of Deep Neural Networks for Symbolic Music Generation
• Learning to Traverse Latent Spaces for Musical Score Inpainting
• Learning Interpretable Representation for Controllable Polyphonic Music Generation
• Continuous Melody Generation via Disentangled Short-Term Representations and Structural Conditions
• From Artificial Neural Networks to Deep Learning for Music Generation -- History, Concepts and Trends
• Symbolic Music Generation with Diffusion Models
• Semi-Recurrent CNN-based VAE-GAN for Sequential Data Generation
• Melody Structure Transfer Network: Generating Music with Separable Self-Attention
• Hierarchical Recurrent Neural Networks for Conditional Melody Generation with Long-term Structure
• Modeling Musical Structure with Artificial Neural Networks