9 papers · 1 filter
AnyBand: Unified Multi-Bandwidth Speech Extension via Frequency-Aware In-Context Spectral Infilling
Junchuan Zhao, Minh Duc Vu, Bowen Zhang +1
Bandwidth extension (BWE) aims to recover missing high-frequency content from band-limited speech. Existing methods often formulate BWE as a fixed or predefined bandwidth conversio…
Joycent: Multi-Accent TTS via Disentangled Accent Modeling and Layer-Specific Conditioning
Xintong Wang, Junchuan Zhao, Ye Wang
Accent text-to-speech (TTS) aims to synthesize speech with a target accent while preserving speaker identity, but faces two key challenges: disentangling accent from speaker charac…
CodecFlow: Efficient Bandwidth Extension via Conditional Flow Matching in Neural Codec Latent Space
Bowen Zhang, Junchuan Zhao, Ian McLoughlin +2
Speech Bandwidth Extension improves clarity and intelligibility by restoring/inferring appropriate high-frequency content for low-bandwidth speech. Existing methods often rely on s…
MSpoofTTS: Multi-Resolution Spoof-Guided Inference for Discrete Speech Synthesis
Junchuan Zhao, Minh Duc Vu, Ye Wang
Neural codec language models enable high-quality discrete speech synthesis, yet their inference remains vulnerable to token-level artifacts and distributional drift that degrade pe…
TED-TTS: Training-Free Intra-Utterance Emotion and Duration Control for Text-to-Speech Synthesis
Qifan Liang, Yuansen Liu, Ruixin Wei +3
While controllable Text-to-Speech (TTS) has achieved notable progress, most existing methods remain limited to inter-utterance-level control, making fine-grained intra-utterance ex…
Peransformer: Improving Low-informed Expressive Performance Rendering with Score-aware Discriminator
Xian He, Wei Zeng, Ye Wang
Highly-informed Expressive Performance Rendering (EPR) systems transform music scores with rich musical annotations into human-like expressive performance MIDI files. While these s…
Disentangling Score Content and Performance Style for Joint Piano Rendering and Transcription
Wei Zeng, Junchuan Zhao, Ye Wang
Expressive performance rendering (EPR) and automatic piano transcription (APT) are fundamental yet inverse tasks in music information retrieval: EPR generates expressive performanc…
CoMelSinger: Discrete Token-Based Zero-Shot Singing Synthesis With Structured Melody Control and Guidance
Junchuan Zhao, Wei Zeng, Tianle Lyu +1
Singing Voice Synthesis (SVS) aims to generate expressive vocal performances from structured musical inputs such as lyrics and pitch sequences. While recent progress in discrete co…
End-to-End Real-World Polyphonic Piano Audio-to-Score Transcription with Hierarchical Decoding
Wei Zeng, Xian He, Ye Wang
Piano audio-to-score transcription (A2S) is an important yet underexplored task with extensive applications for music composition, practice, and analysis. However, existing end-to-…