Dual Path Transformer with Partition Attention

Zhengkai Jiang, Liang Liu, Jiangning Zhang +3

This paper introduces a novel attention mechanism, called dual attention, which is both efficient and effective. The dual attention mechanism consists of two parallel components: l…