Deep learning in bioinformatics: introduction, application, and perspective in big data era

Abstract

Deep learning, which is especially formidable in handling big data, has achieved great success in various fields, including bioinformatics. With the advances of the big data era in biology, it is foreseeable that deep learning will become increasingly important in the field and will be incorporated in vast majorities of analysis pipelines. In this review, we provide both the exoteric introduction of deep learning, and concrete examples and implementations of its representative applications in bioinformatics. We start from the recent achievements of deep learning in the bioinformatics field, pointing out the problems which are suitable to use deep learning. After that, we introduce deep learning in an easy-to-understand fashion, from shallow neural networks to legendary convolutional neural networks, legendary recurrent neural networks, graph neural networks, generative adversarial networks, variational autoencoder, and the most recent state-of-the-art architectures. After that, we provide eight examples, covering five bioinformatics research directions and all the four kinds of data type, with the implementation written in Tensorflow and Keras. Finally, we discuss the common issues, such as overfitting and interpretability, that users will encounter when adopting deep learning methods and provide corresponding suggestions. The implementations are freely available at \url{https://github.com/lykaust15/Deep_learning_examples}.

References in corpus (15)

• Very Deep Convolutional Networks for Large-Scale Image Recognition
• Distilling the Knowledge in a Neural Network
• Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling
• Semi-Supervised Classification with Graph Convolutional Networks
• How transferable are features in deep neural networks?
• The Effectiveness of Data Augmentation in Image Classification using Deep Learning
• On Calibration of Modern Neural Networks
• Understanding deep learning requires rethinking generalization
• Accurate De Novo Prediction of Protein Contact Map by Ultra-Deep Learning Model
• DeepGO: Predicting protein functions from sequence and interactions using a deep ontology-aware classifier
• Predicting multicellular function through multi-layer tissue networks
• Regularization for Deep Learning: A Taxonomy
• Towards Understanding Generalization of Deep Learning: Perspective of Loss Landscapes
• Dr.VAE: Drug Response Variational Autoencoder
• Deep Learning for Design and Retrieval of Nano-photonic Structures