When repeats drive the vocabulary: a Byte-Pair Encoding analysis of T2T primate genomes

Marina Popova, Iaroslav Chelombitko, Aleksey Komissarov

The emergence of telomere-to-telomere (T2T) genome assemblies has opened new avenues for comparative genomics, yet effective tokenization strategies for genomic sequences remain un…