HYBRIDFORMER: improving SqueezeFormer with hybrid attention and NSR mechanism

Yuguang Yang, Yu Pan, Jingjing Yin +3

SqueezeFormer has recently shown impressive performance in automatic speech recognition (ASR). However, its inference speed suffers from the quadratic complexity of softmax-attenti…