4 papers
Can Hierarchical Cross-Modal Fusion Predict Human Perception of AI Dubbed Content?
Ashwini Dasare, Nirmesh Shah, Ashishkumar Gudmalwar +1
Evaluating AI generated dubbed content is inherently multi-dimensional, shaped by synchronization, intelligibility, speaker consistency, emotional alignment, and semantic context.…
Gesture2Speech: How Far Can Hand Movements Shape Expressive Speech?
Lokesh Kumar, Nirmesh Shah, Ashishkumar P. Gudmalwar +1
Human communication seamlessly integrates speech and bodily motion, where hand gestures naturally complement vocal prosody to express intent, emotion, and emphasis. While recent te…
REWIND: Speech Time Reversal for Enhancing Speaker Representations in Diffusion-based Voice Conversion
Ishan D. Biyani, Nirmesh J. Shah, Ashishkumar P. Gudmalwar +2
Speech time reversal refers to the process of reversing the entire speech signal in time, causing it to play backward. Such signals are completely unintelligible since the fundamen…
EmoReg: Directional Latent Vector Modeling for Emotional Intensity Regularization in Diffusion-based Voice Conversion
Ashishkumar Gudmalwar, Ishan D. Biyani, Nirmesh Shah +2
The Emotional Voice Conversion (EVC) aims to convert the discrete emotional state from the source emotion to the target for a given speech utterance while preserving linguistic con…