In-Context Learning can distort the relationship between sequence likelihoods and biological fitness

Pranav Kantroo, Günter P. Wagner, Benjamin B. Machta

Language models have emerged as powerful predictors of the viability of biological sequences. During training these models learn the rules of the grammar obeyed by sequences of ami…