Interpreting Latent Protein Language Model Features with Geometric Annotations

Siddharth Setlur, Djordje Mihajlovic, Darrick Lee

Protein language models (pLMs) encode information about protein sequences which enable downstream tasks such as structure prediction, but their internal representations are not wel…