Pooling Helps, Learned Weighting Hurts In-Context: Decomposing Group Attention

Michael Fore, James Mason Inder, Mrishika Nair +2

Group attention, introduced by the time series forecasting model Chronos-2, attends over the variates of a group at a fixed patch index and serves both multivariate (MV) and in-con…