Residual Dominance as a Structural Account of Last-Item Reliance in Causal Self-Attention Recommenders

Keito Kozaki, Keigo Sakurai, Ren Togo +2

Transformer-based sequential recommenders with causal self-attention often rely heavily on the most recent interaction at inference time, but how this behavior is structurally expr…