Augmenting Molecular Language Models with Local $n$-gram Memory

Xinni Zhang, Zijing Liu, He Cao +2

Transformer-based language models for SMILES strings suffer from a locality gap: standard character-level tokenization fragments chemically meaningful motifs, forcing models to rep…