Greedy Ordering of Layer Weight Matrices in Transformers Improves Translation

Elicia Ye

Prior work has attempted to understand the internal structures and functionalities of Transformer-based encoder-decoder architectures on the level of multi-head attention and feed-…