19 papers
Can Hierarchical Cross-Modal Fusion Predict Human Perception of AI Dubbed Content?
Ashwini Dasare, Nirmesh Shah, Ashishkumar Gudmalwar +1
Evaluating AI generated dubbed content is inherently multi-dimensional, shaped by synchronization, intelligibility, speaker consistency, emotional alignment, and semantic context.…
EW-DETR: Evolving World Object Detection via Incremental Low-Rank DEtection TRansformer
Munish Monga, Vishal Chudasama, Pankaj Wasnik +1
Real-world object detection must operate in evolving environments where new classes emerge, domains shift, and unseen objects must be identified as "unknown": all without accessing…
Gesture2Speech: How Far Can Hand Movements Shape Expressive Speech?
Lokesh Kumar, Nirmesh Shah, Ashishkumar P. Gudmalwar +1
Human communication seamlessly integrates speech and bodily motion, where hand gestures naturally complement vocal prosody to express intent, emotion, and emphasis. While recent te…
Face Time Traveller : Travel Through Ages Without Losing Identity
Purbayan Kar, Ayush Ghadiya, Vishal Chudasama +2
Face aging, an ill-posed problem shaped by environmental and genetic factors, is vital in entertainment, forensics, and digital archiving, where realistic age transformations must…
Windowed SummaryMixing: An Efficient Fine-Tuning of Self-Supervised Learning Models for Low-resource Speech Recognition
Aditya Srinivas Menon, Kumud Tripathi, Raj Gohil +1
Self-supervised learning (SSL) has advanced speech processing but suffers from quadratic complexity due to self-attention. To address this, SummaryMixing (SM) has been proposed as…
Listen Like a Teacher: Mitigating Whisper Hallucinations using Adaptive Layer Attention and Knowledge Distillation
Kumud Tripathi, Aditya Srinivas Menon, Aman Gaurav +2
The Whisper model, an open-source automatic speech recognition system, is widely adopted for its strong performance across multilingual and zero-shot settings. However, it frequent…