What changes when you randomly choose BPE merge operations? Not much

Jonne Sälevä, Constantine Lignos

We introduce three simple randomized variants of byte pair encoding (BPE) and explore whether randomizing the selection of merge operations substantially affects a downstream machi…