1 citations · 1 across the 5 of their papers we have counts for
5 papers
RSIR Transformer: Hierarchical Vision Transformer using Random Sampling Windows and Important Region Windows
Zhemin Zhang, Xun Gong
Recently, Transformers have shown promising performance in various vision tasks. However, the high costs of global self-attention remain challenging for Transformers, especially fo…
Axially Expanded Windows for Local-Global Interaction in Vision Transformers
Zhemin Zhang, Xun Gong
Recently, Transformers have shown promising performance in various vision tasks. A challenging issue in Transformer design is that global self-attention is very expensive to comput…
Self-Supervised Implicit Attention: Guided Attention by The Model Itself
Jinyi Wu, Xun Gong, Zhemin Zhang
We propose Self-Supervised Implicit Attention (SSIA), a new approach that adaptively guides deep neural network models to gain attention by exploiting the properties of the models…
Knowledge Transfer and Distillation from Autoregressive to Non-Autoregressive Speech Recognition
Xun Gong, Zhikai Zhou, Yanmin Qian
Modern non-autoregressive~(NAR) speech recognition systems aim to accelerate the inference speed; however, they suffer from performance degradation compared with autoregressive~(AR…
CensorSpoofer: Asymmetric Communication with IP Spoofing for Censorship-Resistant Web Browsing
Qiyan Wang, Xun Gong, Giang T. K. Nguyen +2
A key challenge in censorship-resistant web browsing is being able to direct legitimate users to redirection proxies while preventing censors, posing as insiders, from discovering…