4 papers
Region-Aware Masking for Accent-Robust Cross-Lingual Text-to-Speech
Haoqi Li, Shivam Mehta, Ravi Teja Gadde +1
Accent leakage remains a critical challenge in cross-lingual zero-shot text-to-speech (TTS), where models inadvertently transfer both the speaker's timbre and source-language accen…
Align Then Reason: A Multimodal Lip-Sync Judge for Dubbing
Rui Liu, Bhavin Jawade, Haoqi Li +4
Dubbing quality control requires a reference-free judge that can determine whether a candidate text line matches a speaker's visible articulation in both content and timing, using…
Louder, Longer, Livelier: Acoustic Shortcuts and Underspecified Rationales in Speech LLM Judges
Mingyue Huo, Shivam Mehta, Bhavin Jawade +2
LLM-as-a-judge is widely used for evaluating text, but extending this paradigm to speech requires models to interpret acoustic as well as linguistic evidence. This introduces a mod…
SpeechCritic: Learning a Diagnostic Speech Judge from Limited Human Preferences
Mingyue Huo, Shivam Mehta, Bhavin Jawade +2
Human speech conveys rich perceptual information, such as emotion and speaker identity, yet most automatic speech quality judges reduce it to a single naturalness score. We study d…