Incorporating Domain Knowledge into Materials Tokenization

Yerim Oh, Jun-Hyung Park, Junho Kim +2

While language models are increasingly utilized in materials science, typical models rely on frequency-centric tokenization methods originally developed for natural language proces…