45 citations · 114 across the 13 of their papers we have counts for
Showing 2022Show all
2 papers · 1 filter
cs.CL2022★ 2 cited
Wukong-Reader: Multi-modal Pre-training for Fine-grained Visual Document Understanding
Haoli Bai, Zhiguang Liu, Xiaojun Meng +9
Unsupervised pre-training on millions of digital-born or scanned documents has shown promising advances in visual document understanding~(VDU). While various vision-language pre-tr…
cs.DC2022
Modern Distributed Data-Parallel Large-Scale Pre-training Strategies For NLP models
Hao Bai
Distributed deep learning is becoming increasingly popular due to the expanding demand for computing resources for deep learning models with a larger amount of parameters. Differen…