11 papers
MeloDISinger: Melody-Aware & Duration-Preserving Singing Voice Editing with Audio Infilling
Yoonjeong Park, Jaekwon Im, Juhan Nam
Text-based singing voice editing (SVE) aims to revise sung lyrics while preserving the original melody, total duration, and non-edited regions. In this paper, we propose MeloDISing…
DTM-Codec: Dynamic Token Masking for VFR Speech Coding with Efficient Boundary Selection
Hoyeol Sohn, Juhan Nam
Variable frame rate (VFR) coding has recently emerged in neural speech codecs, allocating fewer frames to redundant regions and more frames to rapidly changing speech. VFR must tra…
SDP-Codec: A Speaker-Decoupled Speech Codec with Pitch Injection for Low-Bitrate Coding and Zero-Shot Voice Conversion
Hounsu Kim, Juhan Nam
Speaker-decoupled speech codecs can reduce bitrate by separating global speaker attributes from local content and prosody, while supporting voice conversion. Existing speaker-decou…
AdaTT: Text-Guided Instrument Timbre Transfer with Target-Adaptive Structural Control
Dabin Kim, Junwon Lee, Juhan Nam
This paper addresses timbral ambiguity in instrument timbre transfer under fine-grained structural conditions. We argue this issue stems from instrument-specific expressive details…
CounterFlow: A Two-Phase Inference-Time Sampling for Counterfactual Video Foley Generation
Gyubin Lee, Junwon Lee, Juhan Nam
We investigate Counterfactual Video Foley Generation, which aims to adopt a sound-source identity that contradicts the visual evidence while remaining temporally synchronized to a…
Hear What Matters! Text-conditioned Selective Video-to-Audio Generation
Junwon Lee, Juhan Nam, Jiyoung Lee
This work introduces a new task, text-conditioned selective video-to-audio (V2A) generation, which produces only the user-intended sound from a multi-object video. This capability…