44 citations · 104 across the 9 of their papers we have counts for
3 papers · 2 filters
Conformer-based End-to-end Speech Recognition With Rotary Position Embedding
Shengqiang Li, Menglong Xu, Xiao-Lei Zhang
Transformer-based end-to-end speech recognition models have received considerable attention in recent years due to their high training speed and ability to model a long-range globa…
Efficient conformer-based speech recognition with linear attention
Shengqiang Li, Menglong Xu, Xiao-Lei Zhang
Recently, conformer-based end-to-end automatic speech recognition, which outperforms recurrent neural network based ones, has received much attention. Although the parallel computi…
Transformer-based end-to-end speech recognition with residual Gaussian-based self-attention
Chengdong Liang, Menglong Xu, Xiao-Lei Zhang
Self-attention (SA), which encodes vector sequences according to their pairwise similarity, is widely used in speech recognition due to its strong context modeling ability. However…