SCRAM: Spatially Coherent Randomized Attention Maps

Dan A. Calian, Peter Roelants, Jacques Cali +4

Attention mechanisms and non-local mean operations in general are key ingredients in many state-of-the-art deep learning techniques. In particular, the Transformer model based on m…