1 citations · 1 across the 2 of their papers we have counts for
2 papers
cs.CV2021
Scaled ReLU Matters for Training Vision Transformers
Pichao Wang, Xue Wang, Hao Luo +5
Vision transformers (ViTs) have been an alternative design paradigm to convolutional neural networks (CNNs). However, the training of ViTs is much harder than CNNs, as it is sensit…
cs.CV2021★ 1 cited
Decoupled Dynamic Filter Networks
Jingkai Zhou, Varun Jampani, Zhixiong Pi +2
Convolution is one of the basic building blocks of CNN architectures. Despite its common use, standard convolution has two main shortcomings: Content-agnostic and Computation-heavy…