2.5k citations · 5.2k across the 10 of their papers we have counts for
5 papers · 1 filter
Attention Mechanisms in Computer Vision: A Survey
Meng-Hao Guo, Tian-Xing Xu, Jiang-Jiang Liu +7
Humans can naturally and effectively find salient regions in complex scenes. Motivated by this observation, attention mechanisms were introduced into computer vision with the aim o…
Is Attention Better Than Matrix Decomposition?
Zhengyang Geng, Meng-Hao Guo, Hongxu Chen +3
As an essential ingredient of modern deep learning, attention mechanism, especially self-attention, plays a vital role in the global correlation discovery. However, is hand-crafted…
Subdivision-Based Mesh Convolution Networks
Shi-Min Hu, Zheng-Ning Liu, Meng-Hao Guo +4
Convolutional neural networks (CNNs) have made great breakthroughs in 2D computer vision. However, their irregular structure makes it hard to harness the potential of CNNs directly…
Can Attention Enable MLPs To Catch Up With CNNs?
Meng-Hao Guo, Zheng-Ning Liu, Tai-Jiang Mu +3
In the first week of May, 2021, researchers from four different institutions: Google, Tsinghua University, Oxford University and Facebook, shared their latest work [16, 7, 12, 17]…
Beyond Self-attention: External Attention using Two Linear Layers for Visual Tasks
Meng-Hao Guo, Zheng-Ning Liu, Tai-Jiang Mu +1
Attention mechanisms, especially self-attention, have played an increasingly important role in deep feature representation for visual tasks. Self-attention updates the feature at e…