Exploring Data-Driven Chemical SMILES Tokenization Approaches to Identify Key Protein-Ligand Binding Moieties
arXiv:2210.14642 · doi:10.1002/minf.202300249
Abstract
Machine learning models have found numerous successful applications in computational drug discovery. A large body of these models represents molecules as sequences since molecular sequences are easily available, simple, and informative. The sequence-based models often segment molecular sequences into pieces called chemical words (analogous to the words that make up sentences in human languages) and then apply advanced natural language processing techniques for tasks such as drug design, property prediction, and binding affinity prediction. However, the chemical characteristics and significance of these building blocks, chemical words, remain unexplored. This study aims to investigate the chemical vocabularies generated by popular subword tokenization algorithms, namely Byte Pair Encoding (BPE), WordPiece, and Unigram, and identify key chemical words associated with protein-ligand binding. To this end, we build a language-inspired pipeline that treats high affinity ligands of protein targets as documents and selects key chemical words making up those ligands based on tf-idf weighting. Further, we conduct case studies on a number of protein families to analyze the impact of key chemical words on binding. Through our analysis, we find that these key chemical words are specific to protein targets and correspond to known pharmacophores and functional groups. Our findings will help shed light on the chemistry captured by the chemical words, and by machine learning models for drug discovery at large.
arXiv comment16 pages, 11 figures, new computational analysis and extended case studies
References in corpus (7)
- MolTrans: Molecular Interaction Transformer for Drug Target Interaction Prediction
- Self-Referencing Embedded Strings (SELFIES): A 100% robust molecular string representation
- DeepAffinity: Interpretable Deep Learning of Compound-Protein Affinity through Unified Recurrent and Convolutional Neural Networks
- Keeping it Simple: Language Models can learn Complex Molecular Distributions
- Exploring Chemical Space using Natural Language Processing Methodologies for Drug Discovery
- A novel methodology on distributed representations of proteins using their interacting ligands
- ChemBoost: A chemical language based approach for protein-ligand binding affinity prediction