Unified CNNs and transformers underlying learning mechanism reveals multi-head attention modus vivendi

Ella Koresh, Ronit D. Gross, Yuval Meir +3

Convolutional neural networks (CNNs) evaluate short-range correlations in input images which progress along the layers, whereas vision transformer (ViT) architectures evaluate long…