1 paper · 1 filter
Maximilian Kalcher
We present frequency-ordered tokenization (FOT), a simple preprocessing technique that improves lossless text compression by exploiting the power-law frequency distribution of natu…