4 papers
SIV-Bench: A Video Benchmark for Social Interaction Understanding and Reasoning
Fanqi Kong, Weiqin Zu, Xinyu Chen +3
Understanding social interaction, which encompasses perceiving numerous and subtle multimodal cues, inferring unobservable mental states and relations, and dynamically predicting o…
Language and Sketching: An LLM-driven Interactive Multimodal Multitask Robot Navigation Framework
Weiqin Zu, Wenbin Song, Ruiqing Chen +5
The socially-aware navigation system has evolved to adeptly avoid various obstacles while performing multiple tasks, such as point-to-point navigation, human-following, and -guidin…
Cross-Utterance Conditioned VAE for Speech Generation
Yang Li, Cheng Yu, Guangzhi Sun +8
Speech synthesis systems powered by neural networks hold promise for multimedia production, but frequently face issues with producing expressive speech and seamless editing. In res…
Cross-Utterance Conditioned VAE for Non-Autoregressive Text-to-Speech
Yang Li, Cheng Yu, Guangzhi Sun +6
Modelling prosody variation is critical for synthesizing natural and expressive speech in end-to-end text-to-speech (TTS) systems. In this paper, a cross-utterance conditional VAE…