38 citations · 107 across the 9 of their papers we have counts for
Showing 2021Show all
3 papers · 1 filter
cs.CV2021
Contrastive Learning from Extremely Augmented Skeleton Sequences for Self-supervised Action Recognition
Tianyu Guo, Hong Liu, Zhan Chen +3
In recent years, self-supervised representation learning for skeleton-based action recognition has been developed with the advance of contrastive learning methods. The existing con…
cs.DC2021★ 38 cited
GSPMD: General and Scalable Parallelization for ML Computation Graphs
Yuanzhong Xu, HyoukJoong Lee, Dehao Chen +13
We present GSPMD, an automatic, compiler-based parallelization system for common machine learning computations. It allows users to write programs in the same way as for a single de…
cs.CV2021★ 32 cited
Tokens-to-Token ViT: Training Vision Transformers from Scratch on ImageNet
Li Yuan, Yunpeng Chen, Tao Wang +6
Transformers, which are popular for language modeling, have been explored for solving vision tasks recently, e.g., the Vision Transformer (ViT) for image classification. The ViT mo…