8 citations · 13 across the 2 of their papers we have counts for
2 papers
cs.CV2021★ 5 cited
Incorporating Convolution Designs into Visual Transformers
Kun Yuan, Shaopeng Guo, Ziwei Liu +3
Motivated by the success of Transformers in natural language processing (NLP) tasks, there emerge some attempts (e.g., ViT and DeiT) to apply Transformers to the vision domain. How…
cs.DC2021★ 8 cited
BaPipe: Exploration of Balanced Pipeline Parallelism for DNN Training
Letian Zhao, Rui Xu, Tianqi Wang +5
The size of deep neural networks (DNNs) grows rapidly as the complexity of the machine learning algorithm increases. To satisfy the requirement of computation and memory of DNN tra…