77 citations · 96 across the 3 of their papers we have counts for
1 paper · 1 filter
Kyubyong Park, Joohong Lee, Seongbo Jang +1
Typically, tokenization is the very first step in most text processing works. As a token serves as an atomic unit that embeds the contextual information of text, how to define a to…