A Text-guided Protein Design Framework

Abstract

Current AI-assisted protein design mainly utilizes protein sequential and structural information. Meanwhile, there exists tremendous knowledge curated by humans in the text format describing proteins' high-level functionalities. Yet, whether the incorporation of such text data can help protein design tasks has not been explored. To bridge this gap, we propose ProteinDT, a multi-modal framework that leverages textual descriptions for protein design. ProteinDT consists of three subsequent steps: ProteinCLAP which aligns the representation of two modalities, a facilitator that generates the protein representation from the text modality, and a decoder that creates the protein sequences from the representation. To train ProteinDT, we construct a large dataset, SwissProtCLAP, with 441K text and protein pairs. We quantitatively verify the effectiveness of ProteinDT on three challenging tasks: (1) over 90% accuracy for text-guided protein generation; (2) best hit ratio on 12 zero-shot text-guided protein editing tasks; (3) superior performance on four out of six protein property prediction benchmarks.

References in corpus (10)

• Learning Transferable Visual Models From Natural Language Supervision
• Hierarchical Text-Conditional Image Generation with CLIP Latents
• Score-Based Generative Modeling through Stochastic Differential Equations
• GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Models
• Pre-training Molecular Graph Representation with 3D Geometry
• Tranception: protein fitness prediction with autoregressive transformers and inference-time retrieval
• Muse: Text-To-Image Generation via Masked Generative Transformers
• OntoProtein: Protein Pretraining With Gene Ontology Embedding
• SESNet: sequence-structure feature-integrated deep learning method for data-efficient protein engineering
• Text Generation with Diffusion Language Models: A Pre-training Approach with Continuous Paragraph Denoise

Cited by in corpus (2)

• Advancing biomolecular understanding and design following human instructions
• Chemical Language Model Linker: blending text and molecules with modular adapters