1 paper · 1 filter
Liwei Zhang, ZhiMing Tong, Mochen Guan +1
Byte-level BPE fragments Chinese text (for Qwen3.8 on Chinese Wikipedia, 3.84 bytes per token on average; 64% of tokens are single characters) and hides spelling from the model. We…