Diagonalized Attention for Individualized Regression: Latent-Row Localization and Prediction

Borui Peng, Liwei Lin, Feifei Wang +1

Modern text and image representations are often matrix-valued, with rows corresponding to tokens, patches, or other local feature vectors. Predictive information is often sparse bu…