Spatial Bias for Attention-free Non-local Neural Networks

Junhyung Go, Jongbin Ryu

In this paper, we introduce the spatial bias to learn global knowledge without self-attention in convolutional neural networks. Owing to the limited receptive field, conventional c…