most citedBoosting Distributed Training Performance of the Unpadded BERT Model

4 citations · 4 across the 1 of their papers we have counts for

collaborators

1 paper

cs.DC2022★ 4 cited

Boosting Distributed Training Performance of the Unpadded BERT Model

Jinle Zeng, Min Li, Zhihua Wu +4

Pre-training models are an important tool in Natural Language Processing (NLP), while the BERT model is a classic pre-training model whose structure has been widely adopted by foll…