Molecular representation learning with language models and domain-relevant auxiliary tasks

Benedek Fabian, Thomas Edlich, Héléna Gaspar +4

We apply a Transformer architecture, specifically BERT, to learn flexible and high quality molecular representations for drug discovery problems. We study the impact of using diffe…