activity
20202023
most citedBeyond Self-attention: External Attention using Two Linear Layers for Visual Tasks

83 citations · 116 across the 5 of their papers we have counts for

collaborators

7 papers

cs.CV2023★ 24 cited

Deep-Learning-based Fast and Accurate 3D CT Deformable Image Registration in Lung Cancer

Yuzhen Ding, Hongying Feng, Yunze Yang +9

Purpose: In some proton therapy facilities, patient alignment relies on two 2D orthogonal kV images, taken at fixed, oblique angles, as no 3D on-the-bed imaging is available. The v…

cs.CV2022★ 6 cited

Discovering Dynamic Functional Brain Networks via Spatial and Channel-wise Attention

Yiheng Liu, Enjie Ge, Mengshen He +6

Using deep learning models to recognize functional brain networks (FBNs) in functional magnetic resonance imaging (fMRI) has been attracting increasing interest recently. However,…

cs.CV2022★ 1 cited

Eye-gaze-guided Vision Transformer for Rectifying Shortcut Learning

Chong Ma, Lin Zhao, Yuzhong Chen +15

Learning harmful shortcuts such as spurious correlations and biases prevents deep neural networks from learning the meaningful and useful representations, thus jeopardizing the gen…

cs.CV2021★ 2 cited

Can Attention Enable MLPs To Catch Up With CNNs?

Meng-Hao Guo, Zheng-Ning Liu, Tai-Jiang Mu +3

In the first week of May, 2021, researchers from four different institutions: Google, Tsinghua University, Oxford University and Facebook, shared their latest work [16, 7, 12, 17]…

cs.CV2021★ 83 cited

Beyond Self-attention: External Attention using Two Linear Layers for Visual Tasks

Meng-Hao Guo, Zheng-Ning Liu, Tai-Jiang Mu +1

Attention mechanisms, especially self-attention, have played an increasingly important role in deep feature representation for visual tasks. Self-attention updates the feature at e…

cs.CV2020

PCT: Point cloud transformer

Meng-Hao Guo, Jun-Xiong Cai, Zheng-Ning Liu +3

The irregular domain and lack of ordering make it challenging to design deep neural networks for point cloud processing. This paper presents a novel framework named Point Cloud Tra…