activity
20212023
most citedInteractive Audio-text Representation for Automated Audio Captioning with Contrastive Learning

9 citations · 25 across the 11 of their papers we have counts for

collaborators

11 papers

eess.AS2023★ 2 cited

Wav2code: Restore Clean Speech Representations via Codebook Lookup for Noise-Robust ASR

Yuchen Hu, Chen Chen, Qiushi Zhu +1

Automatic speech recognition (ASR) has gained remarkable successes thanks to recent advances of deep learning, but it usually degrades significantly under real-world noisy conditio…

eess.AS2023★ 1 cited

Unifying Speech Enhancement and Separation with Gradient Modulation for End-to-End Noise-Robust Speech Separation

Yuchen Hu, Chen Chen, Heqing Zou +2

Recent studies in neural network-based monaural speech separation (SS) have achieved a remarkable success thanks to increasing ability of long sequence modeling. However, they woul…

eess.AS2023

Gradient Remedy for Multi-Task Learning in End-to-End Noise-Robust Speech Recognition

Yuchen Hu, Chen Chen, Ruizhe Li +2

Speech enhancement (SE) is proved effective in reducing noise from noisy speech signals for downstream automatic speech recognition (ASR), where multi-task learning strategy is emp…

cs.SD2022★ 4 cited

Leveraging Modality-specific Representations for Audio-visual Speech Recognition via Reinforcement Learning

Chen Chen, Yuchen Hu, Qiang Zhang +3

Audio-visual speech recognition (AVSR) has gained remarkable success for ameliorating the noise-robustness of speech recognition. Mainstream methods focus on fusing audio and visua…

eess.AS2022★ 2 cited

Robust Data2vec: Noise-robust Speech Representation Learning for ASR by Combining Regression and Improved Contrastive Learning

Qiu-Shi Zhu, Long Zhou, Jie Zhang +3

Self-supervised pre-training methods based on contrastive learning or regression tasks can utilize more unlabeled data to improve the performance of automatic speech recognition (A…

cs.CL2022

Self-critical Sequence Training for Automatic Speech Recognition

Chen Chen, Yuchen Hu, Nana Hou +3

Although automatic speech recognition (ASR) task has gained remarkable success by sequence-to-sequence models, there are two main mismatches between its training and testing that m…

cs.SD2022★ 9 cited

Interactive Audio-text Representation for Automated Audio Captioning with Contrastive Learning

Chen Chen, Nana Hou, Yuchen Hu +3

Automated Audio captioning (AAC) is a cross-modal task that generates natural language to describe the content of input audio. Most prior works usually extract single-modality acou…

cs.SD2022

Noise-robust Speech Recognition with 10 Minutes Unparalleled In-domain Data

Chen Chen, Nana Hou, Yuchen Hu +2

Noise-robust speech recognition systems require large amounts of training data including noisy speech data and corresponding transcripts to achieve state-of-the-art performances in…

eess.AS2022★ 1 cited

Dual-Path Style Learning for End-to-End Noise-Robust Speech Recognition

Yuchen Hu, Nana Hou, Chen Chen +1

Automatic speech recognition (ASR) systems degrade significantly under noisy conditions. Recently, speech enhancement (SE) is introduced as front-end to reduce noise for ASR, but i…

eess.AS2021★ 5 cited

Interactive Feature Fusion for End-to-End Noise-Robust Speech Recognition

Yuchen Hu, Nana Hou, Chen Chen +1

Speech enhancement (SE) aims to suppress the additive noise from a noisy speech signal to improve the speech's perceptual quality and intelligibility. However, the over-suppression…

cs.CL2021★ 1 cited

The USTC-NELSLIP Systems for Simultaneous Speech Translation Task at IWSLT 2021

Dan Liu, Mengge Du, Xiaoxi Li +2

This paper describes USTC-NELSLIP's submissions to the IWSLT2021 Simultaneous Speech Translation task. We proposed a novel simultaneous translation model, Cross Attention Augmented…