Transformer Reconstructed with Dynamic Value Attention

Xiaowei Wang

Since transformer was firstly published in 2017, several works have been proposed to optimize it. However, the major structure of transformer remains unchanged, ignoring one of its…