Circuits, Features, and Heuristics in Molecular Transformers

Kristof Varadi, Mark Marosi, Peter Antal

Transformers generate valid and diverse chemical structures, but little is known about the mechanisms that enable these models to capture the rules of molecular representation. We…