5 papers
UniTAF: A Modular Framework for Joint Text-to-Speech and Audio-to-Face Modeling
Qiangong Zhou, Nagasaka Tomohiro
This work considers merging two independent models, TTS and A2F, into a unified model to enable internal feature transfer, thereby improving the consistency between audio and facia…
Contribution-aware Token Compression for Efficient Video Understanding via Reinforcement Learning
Yinchao Ma, Qiang Zhou, Zhibin Wang +4
Video large language models have demonstrated remarkable capabilities in video understanding tasks. However, the redundancy of video tokens introduces significant computational ove…
Unified Thinker: A General Reasoning Modular Core for Image Generation
Sashuai Zhou, Qiang Zhou, Jijin Hu +9
Despite impressive progress in high-fidelity image synthesis, generative models still struggle with logic-intensive instruction following, exposing a persistent reasoning--executio…
Neural Directed Speech Enhancement with Dual Microphone Array in High Noise Scenario
Wen Wen, Qiang Zhou, Yu Xi +3
In multi-speaker scenarios, leveraging spatial features is essential for enhancing target speech. While with limited microphone arrays, developing a compact multi-channel speech en…
DLF: Disentangled-Language-Focused Multimodal Sentiment Analysis
Pan Wang, Qiang Zhou, Yawen Wu +2
Multimodal Sentiment Analysis (MSA) leverages heterogeneous modalities, such as language, vision, and audio, to enhance the understanding of human sentiment. While existing models…