A low latency attention module for streaming self-supervised speech representation learning

Jianbo Ma, Siqi Pan, Deepak Chandran +2

The transformer is a fundamental building block in deep learning, and the attention mechanism is the transformer's core component. Self-supervised speech representation learning (S…