Less Is More: Reducing Token Counts Without Compromising Performance

Gyeongje Cho, Yeonkyoung So, Sangmin Lee +1

Tokenization directly affects the inference efficiency of large language models, since fragmented tokenization increases sequence length and generation cost. Although longer, multi…