dna2vec: Consistent vector representations of variable-length k-mers
arXiv:1701.06279
Abstract
One of the ubiquitous representation of long DNA sequence is dividing it into shorter k-mer components. Unfortunately, the straightforward vector encoding of k-mer as a one-hot vector is vulnerable to the curse of dimensionality. Worse yet, the distance between any pair of one-hot vectors is equidistant. This is particularly problematic when applying the latest machine learning algorithms to solve problems in biological sequence analysis. In this paper, we propose a novel method to train distributed representations of variable-length k-mers. Our method is based on the popular word embedding model word2vec, which is trained on a shallow two-layer neural network. Our experiments provide evidence that the summing of dna2vec vectors is akin to nucleotides concatenation. We also demonstrate that there is correlation between Needleman-Wunsch similarity score and cosine similarity of dna2vec vectors.
10 pages, 3 figures, 2 tables
References in corpus (4)
Cited by in corpus (9)
- Deep Learning for Genomics: A Concise Overview
- Hamming Distance Tolerant Content-Addressable Memory (HD-CAM) for Approximate Matching Applications
- Personalised Visual Art Recommendation by Learning Latent Semantic Representations
- Single-Read Reconstruction for DNA Data Storage Using Transformers
- GeneMask: Fast Pretraining of Gene Sequences to Enable Few-Shot Learning
- BERT Goes Shopping: Comparing Distributional Models for Product Representations
- EPIHC: Improving Enhancer-Promoter Interaction Prediction by using Hybrid features and Communicative learning
- Multi-view Banded Spectral Clustering with Application to ICD9 Clustering
- Unlocking Efficiency: Adaptive Masking for Gene Transformer Models