50 citations · 155 across the 10 of their papers we have counts for
3 papers · 1 filter
Profile Prediction: An Alignment-Based Pre-Training Task for Protein Sequence Models
Pascal Sturmfels, Jesse Vig, Ali Madani +1
For protein sequence datasets, unlabeled data has greatly outpaced labeled data due to the high cost of wet-lab characterization. Recent deep-learning approaches to protein predict…
BERTology Meets Biology: Interpreting Attention in Protein Language Models
Jesse Vig, Ali Madani, Lav R. Varshney +3
Transformer architectures have proven to learn useful representations for protein classification and generation tasks. However, these representations present challenges in interpre…
ProGen: Language Modeling for Protein Generation
Ali Madani, Bryan McCann, Nikhil Naik +5
Generative modeling for protein engineering is key to solving fundamental problems in synthetic biology, medicine, and material science. We pose protein engineering as an unsupervi…