Training Compute-Optimal Protein Language Models

Xingyi Cheng, Bo Chen, Pan Li +3

We explore optimally training protein language models, an area of significant interest in biological research where guidance on best practices is limited. Most models are trained w…