19 citations · 19 across the 1 of their papers we have counts for
1 paper
Kyubyong Park, Joohong Lee, Seongbo Jang +1
Typically, tokenization is the very first step in most text processing works. As a token serves as an atomic unit that embeds the contextual information of text, how to define a to…