13 citations · 35 across the 14 of their papers we have counts for
5 papers · 1 filter
Streaming Attention-Based Models with Augmented Memory for End-to-End Speech Recognition
Ching-Feng Yeh, Yongqiang Wang, Yangyang Shi +4
Attention-based models have been gaining popularity recently for their strong performance demonstrated in fields such as machine translation and automatic speech recognition. One m…
Transformer in action: a comparative study of transformer-based acoustic models for large scale speech recognition applications
Yongqiang Wang, Yangyang Shi, Frank Zhang +4
In this paper, we summarize the application of transformer and its streamable variant, Emformer based acoustic model for large scale speech recognition applications. We compare the…
Emformer: Efficient Memory Transformer Based Acoustic Model For Low Latency Streaming Speech Recognition
Yangyang Shi, Yongqiang Wang, Chunyang Wu +5
This paper proposes an efficient memory transformer Emformer for low latency streaming speech recognition. In Emformer, the long-range history context is distilled into an augmente…
Weak-Attention Suppression For Transformer Based Speech Recognition
Yangyang Shi, Yongqiang Wang, Chunyang Wu +5
Transformers, originally proposed for natural language processing (NLP) tasks, have recently achieved great success in automatic speech recognition (ASR). However, adjacent acousti…
Streaming Transformer-based Acoustic Models Using Self-attention with Augmented Memory
Chunyang Wu, Yongqiang Wang, Yangyang Shi +2
Transformer-based acoustic modeling has achieved great suc-cess for both hybrid and sequence-to-sequence speech recogni-tion. However, it requires access to the full sequence, and…