Low-latency vision transformers via large-scale multi-head attention

Ronit D. Gross, Tal Halevi, Ella Koresh +2

The emergence of spontaneous symmetry breaking among a few heads of multi-head attention (MHA) across transformer blocks in classification tasks was recently demonstrated through t…