Induction Meets Biology: Mechanisms of Repeat Detection in Protein Language Models

Gal Pomerants, Yaniv Nikankin, Anja Reusch +3

Protein sequences are abundant in repeating segments, both as exact copies and as approximate segments with mutations. These repeats are important for protein structure and functio…