1 paper · 1 filter
Kevin Slagle
Tokenization is widely used in large language models because it significantly improves performance. However, tokenization imposes several disadvantages, such as performance biases,…