VaPar Synth -- A Variational Parametric Model for Audio Synthesis
arXiv:2004.00001 · doi:10.1109/ICASSP40776.2020.9054181
Abstract
With the advent of data-driven statistical modeling and abundant computing power, researchers are turning increasingly to deep learning for audio synthesis. These methods try to model audio signals directly in the time or frequency domain. In the interest of more flexible control over the generated sound, it could be more useful to work with a parametric representation of the signal which corresponds more directly to the musical attributes such as pitch, dynamics and timbre. We present VaPar Synth - a Variational Parametric Synthesizer which utilizes a conditional variational autoencoder (CVAE) trained on a suitable parametric representation. We demonstrate our proposed model's capabilities via the reconstruction and generation of instrumental tones with flexible control over their pitch.
https://github.com/SubramaniKrishna/VaPar-Synth , Accepted in ICASSP 2020
References in corpus (9)
- Adam: A Method for Stochastic Optimization
- Auto-Encoding Variational Bayes
- WaveNet: A Generative Model for Raw Audio
- Tutorial on Variational Autoencoders
- Neural Audio Synthesis of Musical Notes with WaveNet Autoencoders
- Autoencoders for music sound modeling: a comparison of linear, shallow, deep, recurrent and variational models
- Generative timbre spaces: regularizing variational auto-encoders with perceptual metrics
- Real-valued parametric conditioning of an RNN for interactive sound synthesis
- SING: Symbol-to-Instrument Neural Generator