Transformer-based Streaming ASR with Cumulative Attention

Mohan Li, Shucong Zhang, Catalin Zorila +1

In this paper, we propose an online attention mechanism, known as cumulative attention (CA), for streaming Transformer-based automatic speech recognition (ASR). Inspired by monoton…