70 citations · 74 across the 13 of their papers we have counts for
1 paper · 1 filter
Kaiser Sun, Ana Marasović
An attention matrix of a transformer self-attention sublayer can provably be decomposed into two components and only one of them (effective attention) contributes to the model outp…