Seeing the Unseen: Visual Similarity for Pixel Language Model Adaptation

Ran Zhang, Miryam de Lhoneux, Wessel Poelman

Pixel-based language models (LMs) replace traditional tokenizers by processing rendered images of text, making cross-lingual transfer heavily dependent on the visual and structural…