Deep learning in bioinformatics: introduction, application, and perspective in big data era

Abstract

Deep learning, which is especially formidable in handling big data, has achieved great success in various fields, including bioinformatics. With the advances of the big data era in biology, it is foreseeable that deep learning will become increasingly important in the field and will be incorporated in vast majorities of analysis pipelines. In this review, we provide both the exoteric introduction of deep learning, and concrete examples and implementations of its representative applications in bioinformatics. We start from the recent achievements of deep learning in the bioinformatics field, pointing out the problems which are suitable to use deep learning. After that, we introduce deep learning in an easy-to-understand fashion, from shallow neural networks to legendary convolutional neural networks, legendary recurrent neural networks, graph neural networks, generative adversarial networks, variational autoencoder, and the most recent state-of-the-art architectures. After that, we provide eight examples, covering five bioinformatics research directions and all the four kinds of data type, with the implementation written in Tensorflow and Keras. Finally, we discuss the common issues, such as overfitting and interpretability, that users will encounter when adopting deep learning methods and provide corresponding suggestions. The implementations are freely available at \url{https://github.com/lykaust15/Deep_learning_examples}.

References in corpus (40)

• Very Deep Convolutional Networks for Large-Scale Image Recognition
• A Survey on Deep Learning in Medical Image Analysis
• Distilling the Knowledge in a Neural Network
• Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling
• Semi-Supervised Classification with Graph Convolutional Networks
• Overcoming catastrophic forgetting in neural networks
• How transferable are features in deep neural networks?
• A systematic study of the class imbalance problem in convolutional neural networks
• The Effectiveness of Data Augmentation in Image Classification using Deep Learning
• MXNet: A Flexible and Efficient Machine Learning Library for Heterogeneous Distributed Systems
• On Calibration of Modern Neural Networks
• Low Dose CT Image Denoising Using a Generative Adversarial Network with Wasserstein Distance and Perceptual Loss
• Quantum-Chemical Insights from Deep Tensor Neural Networks
• Modeling polypharmacy side effects with graph convolutional networks
• Exploiting Linear Structure Within Convolutional Networks for Efficient Evaluation
• Tutorial on Variational Autoencoders
• Searching for Exotic Particles in High-Energy Physics with Deep Learning
• Understanding deep learning requires rethinking generalization
• Recurrent Neural Network for Text Classification with Multi-Task Learning
• Accurate De Novo Prediction of Protein Contact Map by Ultra-Deep Learning Model
• A Survey of Model Compression and Acceleration for Deep Neural Networks
• DeepGO: Predicting protein functions from sequence and interactions using a deep ontology-aware classifier
• Group Equivariant Convolutional Networks
• Predicting multicellular function through multi-layer tissue networks
• Aggregated Residual Transformations for Deep Neural Networks
• Generative Image Inpainting with Contextual Attention
• Regularization for Deep Learning: A Taxonomy
• Onto2Vec: joint vector-based representation of biological entities and their ontology-based annotations
• Towards Understanding Generalization of Deep Learning: Perspective of Loss Landscapes
• Classification of Alzheimer's Disease using fMRI Data and Deep Learning Convolutional Neural Networks
• Accelerating Flash Calculation through Deep Learning Methods
• DLBI: Deep learning guided Bayesian inference for structure reconstruction of super-resolution fluorescence microscopy
• RIDDLE: Race and ethnicity Imputation from Disease history with Deep LEarning
• On the Decision Boundary of Deep Neural Networks
• Towards Gene Expression Convolutions using Gene Interaction Graphs
• SupportNet: solving catastrophic forgetting in class incremental learning with support data
• Dr.VAE: Drug Response Variational Autoencoder
• Deep Learning for Design and Retrieval of Nano-photonic Structures
• AUC-maximized Deep Convolutional Neural Fields for Sequence Labeling
• PromID: human promoter prediction by deep learning

Cited by in corpus (1)

• Learning from Learning Machines: Optimisation, Rules, and Social Norms