Vaporetto: Efficient Japanese Tokenization Based on Improved Pointwise Linear Classification

Koichi Akabe, Shunsuke Kanda, Yusuke Oda +1

This paper proposes an approach to improve the runtime efficiency of Japanese tokenization based on the pointwise linear classification (PLC) framework, which formulates the whole…