Building Chinese Lexicons from Scratch by Unsupervised Short Document Self-Segmentation

Daniel Gayo-Avello

Chinese text segmentation is a well-known and difficult problem. On one side, there is not a simple notion of "word" in Chinese language making really hard to implement rule-based…