11 papers
L-Proto: Language-Aware Episodic Prototypical Training for Multilingual Speaker Verification
Hyung-Seok Oh, Deok-Hyeon Cho, Seung-Bin Kim +1
Multilingual speaker verification remains challenging because language-dependent acoustic variability causes speaker identity to become entangled with linguistic characteristics, d…
ImmersiveTTS: Environment-Aware Text-to-Speech with Multimodal Diffusion Transformer and Domain-Specific Representation Alignment
Jun-Hak Yun, Seung-Bin Kim, Seong-Whan Lee
Recent advancements in text-guided audio generation have yielded promising results in diverse domains, including sound effects, speech, and music. However, jointly generating speec…
Affectron: Emotional Speech Synthesis with Affective and Contextually Aligned Nonverbal Vocalizations
Deok-Hyeon Cho, Hyung-Seok Oh, Seung-Bin Kim +1
Nonverbal vocalizations (NVs), such as laughter and sighs, are central to the expression of affective cues in emotional speech synthesis. However, learning diverse and contextually…
Toward Complex-Valued Neural Networks for Waveform Generation
Hyung-Seok Oh, Deok-Hyeon Cho, Seung-Bin Kim +1
Neural vocoders have recently advanced waveform generation, yielding natural and expressive audio. Among these approaches, iSTFT-based vocoders have recently gained attention. They…
EmoSphere-SER: Enhancing Speech Emotion Recognition Through Spherical Representation with Auxiliary Classification
Deok-Hyeon Cho, Hyung-Seok Oh, Seung-Bin Kim +1
Speech emotion recognition predicts a speaker's emotional state from speech signals using discrete labels or continuous dimensions such as arousal, valence, and dominance (VAD). We…
DiEmo-TTS: Disentangled Emotion Representations via Self-Supervised Distillation for Cross-Speaker Emotion Transfer in Text-to-Speech
Deok-Hyeon Cho, Hyung-Seok Oh, Seung-Bin Kim +1
Cross-speaker emotion transfer in speech synthesis relies on extracting speaker-independent emotion embeddings for accurate emotion modeling without retaining speaker traits. Howev…