2 citations · 6 across the 6 of their papers we have counts for
6 papers
DiffSal: Joint Audio and Video Learning for Diffusion Saliency Prediction
Junwen Xiong, Peng Zhang, Tao You +3
Audio-visual saliency prediction can draw support from diverse modality complements, but further performance enhancement is still challenged by customized architectures as well as…
UniST: Towards Unifying Saliency Transformer for Video Saliency Prediction and Detection
Junwen Xiong, Peng Zhang, Chuanyue Li +3
Video saliency prediction and detection are thriving research domains that enable computers to simulate the distribution of visual attention akin to how humans perceiving dynamic s…
FTFDNet: Learning to Detect Talking Face Video Manipulation with Tri-Modality Interaction
Ganglai Wang, Peng Zhang, Junwen Xiong +3
DeepFake based digital facial forgery is threatening public media security, especially when lip manipulation has been used in talking face generation, and the difficulty of fake vi…
CASP-Net: Rethinking Video Saliency Prediction from an Audio-VisualConsistency Perceptual Perspective
Junwen Xiong, Ganglai Wang, Peng Zhang +3
Incorporating the audio stream enables Video Saliency Prediction (VSP) to imitate the selective attention mechanism of human brain. By focusing on the benefits of joint auditory an…
Audio-visual speech separation based on joint feature representation with cross-modal attention
Junwen Xiong, Peng Zhang, Lei Xie +3
Multi-modal based speech separation has exhibited a specific advantage on isolating the target character in multi-talker noisy environments. Unfortunately, most of current separati…
Look\&Listen: Multi-Modal Correlation Learning for Active Speaker Detection and Speech Enhancement
Junwen Xiong, Yu Zhou, Peng Zhang +3
Active speaker detection and speech enhancement have become two increasingly attractive topics in audio-visual scenario understanding. According to their respective characteristics…