4 papers
Fast Speech Foundation Model Distillation Using Interleaved Stacking
Eungbeom Kim, Kyogu Lee
Distilling a large speech foundation model (SFM) into an efficient student model has been successfully applied to low-resource environments. Although distillation reduces inference…
Reverse Engineering of Music Mixing Graphs with Differentiable Processors and Iterative Pruning
Sungho Lee, Marco MartÃnez-RamÃrez, Wei-Hsiang Liao +4
Reverse engineering of music mixes aims to uncover how dry source signals are processed and combined to produce a final mix. We extend the prior works to reflect the compositional…
Variable Bitrate Residual Vector Quantization for Audio Coding
Yunkee Chae, Woosung Choi, Yuhta Takida +8
Recent state-of-the-art neural audio compression models have progressively adopted residual vector quantization (RVQ). Despite this success, these models employ a fixed number of c…
TokenSynth: A Token-based Neural Synthesizer for Instrument Cloning and Text-to-Instrument
Kyungsu Kim, Junghyun Koo, Sungho Lee +2
Recent advancements in neural audio codecs have enabled the use of tokenized audio representations in various audio generation tasks, such as text-to-speech, text-to-audio, and tex…