Less Memory, Faster Speed: Refining Self-Attention Module for Image Reconstruction

Zheng Wang, Jianwu Li, Ge Song +1

Self-attention (SA) mechanisms can capture effectively global dependencies in deep neural networks, and have been applied to natural language processing and image processing succes…