49 citations · 57 across the 3 of their papers we have counts for
1 paper · 1 filter
Xinying Song, Alex Salcianu, Yang Song +2
Tokenization is a fundamental preprocessing step for almost all NLP tasks. In this paper, we propose efficient algorithms for the WordPiece tokenization used in BERT, from single-w…