11 citations · 19 across the 3 of their papers we have counts for
3 papers
cs.DC2024★ 1 cited
DSP: Dynamic Sequence Parallelism for Multi-Dimensional Transformers
Xuanlei Zhao, Shenggan Cheng, Chang Chen +4
Scaling multi-dimensional transformers to long sequences is indispensable across various domains. However, the challenges of large memory requirements and slow speeds of such seque…
cs.CV2023★ 7 cited
InfoBatch: Lossless Training Speed Up by Unbiased Dynamic Data Pruning
Ziheng Qin, Kai Wang, Zangwei Zheng +8
Data pruning aims to obtain lossless performances with less overall cost. A common approach is to filter out samples that make less contribution to the training. This could lead to…
cs.CV2022★ 11 cited
Crafting Better Contrastive Views for Siamese Representation Learning
Xiangyu Peng, Kai Wang, Zheng Zhu +2
Recent self-supervised contrastive learning methods greatly benefit from the Siamese structure that aims at minimizing distances between positive pairs. For high performance Siames…