487 citations · 583 across the 4 of their papers we have counts for
4 papers
Can Attention Enable MLPs To Catch Up With CNNs?
Meng-Hao Guo, Zheng-Ning Liu, Tai-Jiang Mu +3
In the first week of May, 2021, researchers from four different institutions: Google, Tsinghua University, Oxford University and Facebook, shared their latest work [16, 7, 12, 17]…
Beyond Self-attention: External Attention using Two Linear Layers for Visual Tasks
Meng-Hao Guo, Zheng-Ning Liu, Tai-Jiang Mu +1
Attention mechanisms, especially self-attention, have played an increasingly important role in deep feature representation for visual tasks. Self-attention updates the feature at e…
PCT: Point cloud transformer
Meng-Hao Guo, Jun-Xiong Cai, Zheng-Ning Liu +3
The irregular domain and lack of ordering make it challenging to design deep neural networks for point cloud processing. This paper presents a novel framework named Point Cloud Tra…
Semi-Supervised Brain Lesion Segmentation with an Adapted Mean Teacher Model
Wenhui Cui, Yanlin Liu, Yuxing Li +6
Automated brain lesion segmentation provides valuable information for the analysis and intervention of patients. In particular, methods based on convolutional neural networks (CNNs…