5 papers
Differentiable Acoustic Radiance Transfer
Sungho Lee, Matteo Scerbo, Seungu Han +3
Geometric acoustics is an efficient framework for room acoustics modeling, governed by the canonical time-dependent rendering equation. Acoustic radiance transfer (ART) solves the…
Rethinking Speech Representation Aggregation in Speech Enhancement: A Phonetic Mutual Information Perspective
Seungu Han, Sungho Lee, Kyogu Lee
Recent speech enhancement (SE) models increasingly leverage self-supervised learning (SSL) representations for their rich semantic information. Typically, intermediate features are…
Reverse Engineering of Music Mixing Graphs with Differentiable Processors and Iterative Pruning
Sungho Lee, Marco MartÃnez-RamÃrez, Wei-Hsiang Liao +4
Reverse engineering of music mixes aims to uncover how dry source signals are processed and combined to produce a final mix. We extend the prior works to reflect the compositional…
Few-step Adversarial Schrödinger Bridge for Generative Speech Enhancement
Seungu Han, Sungho Lee, Juheon Lee +1
Deep generative models have recently been employed for speech enhancement to generate perceptually valid clean speech on large-scale datasets. Several diffusion models have been pr…
TokenSynth: A Token-based Neural Synthesizer for Instrument Cloning and Text-to-Instrument
Kyungsu Kim, Junghyun Koo, Sungho Lee +2
Recent advancements in neural audio codecs have enabled the use of tokenized audio representations in various audio generation tasks, such as text-to-speech, text-to-audio, and tex…