Time Domain Neural Audio Style Transfer

Abstract

A recently published method for audio style transfer has shown how to extend the process of image style transfer to audio. This method synthesizes audio "content" and "style" independently using the magnitudes of a short time Fourier transform, shallow convolutional networks with randomly initialized filters, and iterative phase reconstruction with Griffin-Lim. In this work, we explore whether it is possible to directly optimize a time domain audio signal, removing the process of phase reconstruction and opening up possibilities for real-time applications and higher quality syntheses. We explore a variety of style transfer processes on neural networks that operate directly on time domain audio signals and demonstrate one such network capable of audio stylization.

References in corpus (1)

• Audio Spectrogram Representations for Processing with Convolutional Neural Networks

Cited by in corpus (5)

• Neural Style Transfer: A Review
• A Comprehensive Survey on Deep Music Generation: Multi-level Representations, Algorithms, Evaluations, and Future Directions
• Generating Albums with SampleRNN to Imitate Metal, Rock, and Punk Bands
• Overview of Tasks and Investigation of Subjective Evaluation Methods in Environmental Sound Synthesis and Conversion
• A Lightweight Music Texture Transfer System