activity
20202023
most citedTransformer-based End-to-End Speech Recognition with Local Dense Synthesizer Attention

39 citations · 58 across the 7 of their papers we have counts for

collaborators

7 papers

cs.CL2023

The GUA-Speech System Description for CNVSRC Challenge 2023

Shengqiang Li, Chao Lei, Baozhong Ma +2

This study describes our system for Task 1 Single-speaker Visual Speech Recognition (VSR) fixed track in the Chinese Continuous Visual Speech Recognition Challenge (CNVSRC) 2023. S…

cs.SD2022

Fast-U2++: Fast and Accurate End-to-End Speech Recognition in Joint CTC/Attention Frames

Chengdong Liang, Xiao-Lei Zhang, BinBin Zhang +5

Recently, the unified streaming and non-streaming two-pass (U2/U2++) end-to-end model for speech recognition has shown great performance in terms of streaming capability, accuracy…

cs.SD2021

Conformer-based End-to-end Speech Recognition With Rotary Position Embedding

Shengqiang Li, Menglong Xu, Xiao-Lei Zhang

Transformer-based end-to-end speech recognition models have received considerable attention in recent years due to their high training speed and ability to model a long-range globa…

eess.AS2021

AUC Optimization for Robust Small-footprint Keyword Spotting with Limited Training Data

Menglong Xu, Shengqiang Li, Chengdong Liang +1

Deep neural networks provide effective solutions to small-footprint keyword spotting (KWS). However, if training data is limited, it remains challenging to achieve robust and highl…

eess.AS2021★ 8 cited

Libri-adhoc40: A dataset collected from synchronized ad-hoc microphone arrays

Shanzheng Guan, Shupei Liu, Junqi Chen +8

Recently, there is a research trend on ad-hoc microphone arrays. However, most research was conducted on simulated data. Although some data sets were collected with a small number…

cs.SD2021★ 11 cited

Efficient conformer-based speech recognition with linear attention

Shengqiang Li, Menglong Xu, Xiao-Lei Zhang

Recently, conformer-based end-to-end automatic speech recognition, which outperforms recurrent neural network based ones, has received much attention. Although the parallel computi…

cs.SD2020★ 39 cited

Transformer-based End-to-End Speech Recognition with Local Dense Synthesizer Attention

Menglong Xu, Shengqiang Li, Xiao-Lei Zhang

Recently, several studies reported that dot-product selfattention (SA) may not be indispensable to the state-of-theart Transformer models. Motivated by the fact that dense synthesi…