Interpolation between Convolution and Attention via K-Nearest Neighbors

Mingi Kang

The shift from Convolutional Neural Networks to Transformers has reshaped computer vision, yet these two architectural families are typically viewed as fundamentally distinct. Conv…