2.5k citations · 5.2k across the 10 of their papers we have counts for
10 papers
Long Range Pooling for 3D Large-Scale Scene Understanding
Xiang-Li Li, Meng-Hao Guo, Tai-Jiang Mu +2
Inspired by the success of recent vision transformers and large kernel design in convolutional neural networks (CNNs), in this paper, we analyze and explore essential reasons for t…
SegNeXt: Rethinking Convolutional Attention Design for Semantic Segmentation
Meng-Hao Guo, Cheng-Ze Lu, Qibin Hou +3
We present SegNeXt, a simple convolutional network architecture for semantic segmentation. Recent transformer-based models have dominated the field of semantic segmentation due to…
Visual Attention Network
Meng-Hao Guo, Cheng-Ze Lu, Zheng-Ning Liu +2
While originally designed for natural language processing tasks, the self-attention mechanism has recently taken various computer vision areas by storm. However, the 2D nature of i…
Attention Mechanisms in Computer Vision: A Survey
Meng-Hao Guo, Tian-Xing Xu, Jiang-Jiang Liu +7
Humans can naturally and effectively find salient regions in complex scenes. Motivated by this observation, attention mechanisms were introduced into computer vision with the aim o…
Is Attention Better Than Matrix Decomposition?
Zhengyang Geng, Meng-Hao Guo, Hongxu Chen +3
As an essential ingredient of modern deep learning, attention mechanism, especially self-attention, plays a vital role in the global correlation discovery. However, is hand-crafted…
Subdivision-Based Mesh Convolution Networks
Shi-Min Hu, Zheng-Ning Liu, Meng-Hao Guo +4
Convolutional neural networks (CNNs) have made great breakthroughs in 2D computer vision. However, their irregular structure makes it hard to harness the potential of CNNs directly…
Can Attention Enable MLPs To Catch Up With CNNs?
Meng-Hao Guo, Zheng-Ning Liu, Tai-Jiang Mu +3
In the first week of May, 2021, researchers from four different institutions: Google, Tsinghua University, Oxford University and Facebook, shared their latest work [16, 7, 12, 17]…
Beyond Self-attention: External Attention using Two Linear Layers for Visual Tasks
Meng-Hao Guo, Zheng-Ning Liu, Tai-Jiang Mu +1
Attention mechanisms, especially self-attention, have played an increasingly important role in deep feature representation for visual tasks. Self-attention updates the feature at e…
PCT: Point cloud transformer
Meng-Hao Guo, Jun-Xiong Cai, Zheng-Ning Liu +3
The irregular domain and lack of ordering make it challenging to design deep neural networks for point cloud processing. This paper presents a novel framework named Point Cloud Tra…
Semi-Supervised Brain Lesion Segmentation with an Adapted Mean Teacher Model
Wenhui Cui, Yanlin Liu, Yuxing Li +6
Automated brain lesion segmentation provides valuable information for the analysis and intervention of patients. In particular, methods based on convolutional neural networks (CNNs…