57 citations · 70 across the 7 of their papers we have counts for
8 papers
LibriSQA: A Novel Dataset and Framework for Spoken Question Answering with Large Language Models
Zihan Zhao, Yiyang Jiang, Heyang Liu +2
While Large Language Models (LLMs) have demonstrated commendable performance across a myriad of domains and tasks, existing LLMs still exhibit a palpable deficit in handling multim…
Knowledge-aware Bayesian Co-attention for Multimodal Emotion Recognition
Zihan Zhao, Yu Wang, Yanfeng Wang
Multimodal emotion recognition is a challenging research area that aims to fuse different modalities to predict human emotion. However, most existing models that are based on atten…
Multi-level Fusion of Wav2vec 2.0 and BERT for Multimodal Emotion Recognition
Zihan Zhao, Yanfeng Wang, Yu Wang
The research and applications of multimodal emotion recognition have become increasingly popular recently. However, multimodal emotion recognition faces the challenge of lack of da…
Nextformer: A ConvNeXt Augmented Conformer For End-To-End Speech Recognition
Yongjun Jiang, Jian Yu, Wenwen Yang +2
Conformer models have achieved state-of-the-art(SOTA) results in end-to-end speech recognition. However Conformer mainly focuses on temporal modeling while pays less attention on t…
FGraDA: A Dataset and Benchmark for Fine-Grained Domain Adaptation in Machine Translation
Wenhao Zhu, Shujian Huang, Tong Pu +6
Previous research for adapting a general neural machine translation (NMT) model into a specific domain usually neglects the diversity in translation within the same domain, which i…
ChoreoNet: Towards Music to Dance Synthesis with Choreographic Action Unit
Zijie Ye, Haozhe Wu, Jia Jia +4
Dance and music are two highly correlated artistic forms. Synthesizing dance motions has attracted much attention recently. Most previous works conduct music-to-dance synthesis via…
Learning Contextualized Sentence Representations for Document-Level Neural Machine Translation
Pei Zhang, Xu Zhang, Wei Chen +3
Document-level machine translation incorporates inter-sentential dependencies into the translation of a source sentence. In this paper, we propose a new framework to model cross-se…
Modality Attention for End-to-End Audio-visual Speech Recognition
Pan Zhou, Wenwen Yang, Wei Chen +2
Audio-visual speech recognition (AVSR) system is thought to be one of the most promising solutions for robust speech recognition, especially in noisy environment. In this paper, we…