Scaling and Data Saturation in Protein Language Models

Aviv Spinner, Erika DeBenedictis, Corey M. Hudson

Data in biology is redundant, noisy, and sparse. How does the type and scale of available data impact model performance? In this work, we specifically investigate how protein langu…