79 citations · 155 across the 15 of their papers we have counts for
16 papers
DualSpeech: Enhancing Speaker-Fidelity and Text-Intelligibility Through Dual Classifier-Free Guidance
Jinhyeok Yang, Junhyeok Lee, Hyeong-Seok Choi +3
Text-to-Speech (TTS) models have advanced significantly, aiming to accurately replicate human speech's diversity, including unique speaker identities and linguistic nuances. Despit…
Yet Another Generative Model For Room Impulse Response Estimation
Sungho Lee, Hyeong-Seok Choi, Kyogu Lee
Recent neural room impulse response (RIR) estimators typically comprise an encoder for reference audio analysis and a generator for RIR synthesis. Especially, it is the performance…
Towards trustworthy phoneme boundary detection with autoregressive model and improved evaluation metric
Hyeongju Kim, Hyeong-Seok Choi
Phoneme boundary detection has been studied due to its central role in various speech applications. In this work, we point out that this task needs to be addressed not only by algo…
NANSY++: Unified Voice Synthesis with Neural Analysis and Synthesis
Hyeong-Seok Choi, Jinhyeok Yang, Juheon Lee +1
Various applications of voice synthesis have been developed independently despite the fact that they generate "voice" as output in common. In addition, most of the voice synthesis…
Expressive Singing Synthesis Using Local Style Token and Dual-path Pitch Encoder
Juheon Lee, Hyeong-Seok Choi, Kyogu Lee
This paper proposes a controllable singing voice synthesis system capable of generating expressive singing voice with two novel methodologies. First, a local style token module, wh…
Neural Analysis and Synthesis: Reconstructing Speech from Self-Supervised Representations
Hyeong-Seok Choi, Juheon Lee, Wansoo Kim +3
We present a neural analysis and synthesis (NANSY) framework that can manipulate voice, pitch, and speed of an arbitrary speech signal. Most of the previous works have focused on u…
Differentiable Artificial Reverberation
Sungho Lee, Hyeong-Seok Choi, Kyogu Lee
Artificial reverberation (AR) models play a central role in various audio applications. Therefore, estimating the AR model parameters (ARPs) of a reference reverberation is a cruci…
Room adaptive conditioning method for sound event classification in reverberant environments
Jaejun Lee, Donmoon Lee, Hyeong-Seok Choi +1
Ensuring performance robustness for a variety of situations that can occur in real-world environments is one of the challenging tasks in sound event classification. One of the unpr…
Real-time Denoising and Dereverberation with Tiny Recurrent U-Net
Hyeong-Seok Choi, Sungjin Park, Jie Hwan Lee +3
Modern deep learning-based models have seen outstanding performance improvement with speech enhancement tasks. The number of parameters of state-of-the-art models, however, is ofte…
Exploring Aligned Lyrics-Informed Singing Voice Separation
Chang-Bin Jeon, Hyeong-Seok Choi, Kyogu Lee
In this paper, we propose a method of utilizing aligned lyrics as additional information to improve the performance of singing voice separation. We have combined the highway networ…
Phase-aware Single-stage Speech Denoising and Dereverberation with U-Net
Hyeong-Seok Choi, Hoon Heo, Jie Hwan Lee +1
In this work, we tackle a denoising and dereverberation problem with a single-stage framework. Although denoising and dereverberation may be considered two separate challenging tas…
From Inference to Generation: End-to-end Fully Self-supervised Generation of Human Face from Speech
Hyeong-Seok Choi, Changdae Park, Kyogu Lee
This work seeks the possibility of generating the human face from voice solely based on the audio-visual data without any human-labeled annotations. To this end, we propose a multi…
Disentangling Timbre and Singing Style with Multi-singer Singing Synthesis System
Juheon Lee, Hyeong-Seok Choi, Junghyun Koo +1
In this study, we define the identity of the singer with two independent concepts - timbre and singing style - and propose a multi-singer singing synthesis system that can model th…
Audio query-based music source separation
Jie Hwan Lee, Hyeong-Seok Choi, Kyogu Lee
In recent years, music source separation has been one of the most intensively studied research areas in music information retrieval. Improvements in deep learning lead to a big pro…
Adversarially Trained End-to-end Korean Singing Voice Synthesis System
Juheon Lee, Hyeong-Seok Choi, Chang-Bin Jeon +2
In this paper, we propose an end-to-end Korean singing voice synthesis system from lyrics and a symbolic melody using the following three novel approaches: 1) phonetic enhancement…
Phase-aware Speech Enhancement with Deep Complex U-Net
Hyeong-Seok Choi, Jang-Hyun Kim, Jaesung Huh +3
Most deep learning-based models for speech enhancement have mainly focused on estimating the magnitude of spectrogram while reusing the phase from noisy speech for reconstruction.…