Circuit Tracing in Autoregressive Protein Language Models

Darin Tsui, William Deinzer, Daniel Saeedi +1

Protein language models (pLMs) can generate novel protein sequences with properties beyond those observed in nature, yet the mechanisms underlying protein generation remain poorly…