1 citations · 1 across the 1 of their papers we have counts for
1 paper · 1 filter
Kaiser Sun, Ana Marasović
An attention matrix of a transformer self-attention sublayer can provably be decomposed into two components and only one of them (effective attention) contributes to the model outp…