activity
20182026
most citedBiFormer: Vision Transformer with Bi-Level Routing Attention

67 citations · 221 across the 19 of their papers we have counts for

collaborators
Showing 2020Show all

5 papers · 1 filter

cs.LG2020

Understanding the wiring evolution in differentiable neural architecture search

Sirui Xie, Shoukang Hu, Xinjiang Wang +4

Controversy exists on whether differentiable neural architecture search methods discover wiring topology effectively. To understand how wiring topology evolves, we study the underl…

cs.CV2020★ 7 cited

Scale-Equalizing Pyramid Convolution for Object Detection

Xinjiang Wang, Shilong Zhang, Zhuoran Yu +2

Feature pyramid has been an efficient method to extract features at different scales. Development over this method mainly focuses on aggregating contextual information at different…

cs.LG2020★ 24 cited

AdaX: Adaptive Gradient Descent with Exponential Long Term Memory

Wenjie Li, Zhaoyang Zhang, Xinjiang Wang +1

Although adaptive optimization algorithms such as Adam show fast convergence in many machine learning tasks, this paper identifies a problem of Adam by analyzing its performance in…

cs.LG2020★ 10 cited

Convolution-Weight-Distribution Assumption: Rethinking the Criteria of Channel Pruning

Zhongzhan Huang, Wenqi Shao, Xinjiang Wang +2

Channel pruning is a popular technique for compressing convolutional neural networks (CNNs), where various pruning criteria have been proposed to remove the redundant filters. From…

cs.LG2020★ 1 cited

How Does BN Increase Collapsed Neural Network Filters?

Sheng Zhou, Xinjiang Wang, Ping Luo +3

Improving sparsity of deep neural networks (DNNs) is essential for network compression and has drawn much attention. In this work, we disclose a harmful sparsifying process called…