Understanding How Encoder-Decoder Architectures Attend

Kyle Aitken, Vinay V Ramasesh, Yuan Cao +1

Encoder-decoder networks with attention have proven to be a powerful way to solve many sequence-to-sequence tasks. In these networks, attention aligns encoder and decoder states an…