1 citations · 1 across the 1 of their papers we have counts for
1 paper
Kaiser Sun, Ana Marasović
An attention matrix of a transformer self-attention sublayer can provably be decomposed into two components and only one of them (effective attention) contributes to the model outp…