Beyond Two Bytes per Letter: Tokenization Overhead in Cyrillic AI Systems

Ivan Dobrovolskyi

Modern multilingual tokenizers often fragment Ukrainian and other underrepresented Cyrillic-script languages more heavily than English, creating disparities in cost and context cap…