DrugDBEmbed : Semantic Queries on Relational Database using Supervised Column Encodings

Abstract

Traditional relational databases contain a lot of latent semantic information that have largely remained untapped due to the difficulty involved in automatically extracting such information. Recent works have proposed unsupervised machine learning approaches to extract such hidden information by textifying the database columns and then projecting the text tokens onto a fixed dimensional semantic vector space. However, in certain databases, task-specific class labels may be available, which unsupervised approaches are unable to lever in a principled manner. Also, when embeddings are generated at individual token level, then column encoding of multi-token text column has to be computed by taking the average of the vectors of the tokens present in that column for any given row. Such averaging approach may not produce the best semantic vector representation of the multi-token text column, as observed while encoding paragraphs or documents in natural language processing domain. With these shortcomings in mind, we propose a supervised machine learning approach using a Bi-LSTM based sequence encoder to directly generate column encodings for multi-token text columns of the DrugBank database, which contains gold standard drug-drug interaction (DDI) labels. Our text data driven encoding approach achieves very high Accuracy on the supervised DDI prediction task for some columns and we use those supervised column encodings to simulate and evaluate the Analogy SQL queries on relational data to demonstrate the efficacy of our technique.

References in corpus (21)

• Scikit-learn: Machine Learning in Python
• Efficient Estimation of Word Representations in Vector Space
• Distributed Representations of Words and Phrases and their Compositionality
• PyTorch: An Imperative Style, High-Performance Deep Learning Library
• Distributed Representations of Sentences and Documents
• NLTK: The Natural Language Toolkit
• Modeling polypharmacy side effects with graph convolutional networks
• Exploiting Similarities among Languages for Machine Translation
• word2vec Explained: deriving Mikolov et al.'s negative-sampling word-embedding method
• Convolutional Neural Networks for Sentence Classification
• Recurrent Neural Network for Text Classification with Multi-Task Learning
• Comparative Study of CNN and RNN for Natural Language Processing
• Document Embedding with Paragraph Vectors
• Drug Similarity Integration Through Attentive Multi-view Graph Auto-Encoders
• Improving Neural Relation Extraction with Implicit Mutual Relations
• Cognitive Database: A Step towards Endowing Relational Databases with Artificial Intelligence Capabilities
• Enhancing Drug-Drug Interaction Extraction from Texts by Molecular Structure Information
• Enabling Cognitive Intelligence Queries in Relational Databases using Low-dimensional Word Embeddings
• Merging datasets through deep learning
• RETRO: Relation Retrofitting For In-Database Machine Learning on Textual Data
• On Embeddings in Relational Databases