Parallel Scheduling Self-attention Mechanism: Generalization and Optimization

Mingfei Yu, Masahiro Fujita

Over the past few years, self-attention is shining in the field of deep learning, especially in the domain of natural language processing(NLP). Its impressive effectiveness, along…