44 citations · 104 across the 9 of their papers we have counts for
5 papers · 1 filter
Conformer-based End-to-end Speech Recognition With Rotary Position Embedding
Shengqiang Li, Menglong Xu, Xiao-Lei Zhang
Transformer-based end-to-end speech recognition models have received considerable attention in recent years due to their high training speed and ability to model a long-range globa…
Efficient conformer-based speech recognition with linear attention
Shengqiang Li, Menglong Xu, Xiao-Lei Zhang
Recently, conformer-based end-to-end automatic speech recognition, which outperforms recurrent neural network based ones, has received much attention. Although the parallel computi…
Transformer-based end-to-end speech recognition with residual Gaussian-based self-attention
Chengdong Liang, Menglong Xu, Xiao-Lei Zhang
Self-attention (SA), which encodes vector sequences according to their pairwise similarity, is widely used in speech recognition due to its strong context modeling ability. However…
Transformer-based End-to-End Speech Recognition with Local Dense Synthesizer Attention
Menglong Xu, Shengqiang Li, Xiao-Lei Zhang
Recently, several studies reported that dot-product selfattention (SA) may not be indispensable to the state-of-theart Transformer models. Motivated by the fact that dense synthesi…
Depthwise Separable Convolutional ResNet with Squeeze-and-Excitation Blocks for Small-footprint Keyword Spotting
Menglong Xu, Xiao-Lei Zhang
One difficult problem of keyword spotting is how to miniaturize its memory footprint while maintain a high precision. Although convolutional neural networks have shown to be effect…