A Survey on State-of-the-art Deep Learning Applications and Challenges

Abstract

Deep learning, a branch of artificial intelligence, is a data-driven method that uses multiple layers of interconnected units or neurons to learn intricate patterns and representations directly from raw input data. Empowered by this learning capability, it has become a powerful tool for solving complex problems and is the core driver of many groundbreaking technologies and innovations. Building a deep learning model is challenging due to the algorithm's complexity and the dynamic nature of real-world problems. Several studies have reviewed deep learning concepts and applications. However, the studies mostly focused on the types of deep learning models and convolutional neural network architectures, offering limited coverage of the state-of-the-art deep learning models and their applications in solving complex problems across different domains. Therefore, motivated by the limitations, this study aims to comprehensively review the state-of-the-art deep learning models in computer vision, natural language processing, time series analysis and pervasive computing, and robotics. We highlight the key features of the models and their effectiveness in solving the problems within each domain. Furthermore, this study presents the fundamentals of deep learning, various deep learning model types and prominent convolutional neural network architectures. Finally, challenges and future directions in deep learning research are discussed to offer a broader perspective for future researchers.

Update journal reference. This manuscript has been published in Engineering Applications of Artificial Intelligence (Elsevier)

References in corpus (41)

• Adam: A Method for Stochastic Optimization
• Very Deep Convolutional Networks for Large-Scale Image Recognition
• An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
• Neural Machine Translation by Jointly Learning to Align and Translate
• Sequence to Sequence Learning with Neural Networks
• YOLOv4: Optimal Speed and Accuracy of Object Detection
• Rethinking Atrous Convolution for Semantic Image Segmentation
• Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcasting
• Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation
• Intriguing properties of neural networks
• Attention U-Net: Learning Where to Look for the Pancreas
• Deep learning with convolutional neural networks for EEG decoding and visualization
• A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questions
• A Structured Self-attentive Sentence Embedding
• Sequence Transduction with Recurrent Neural Networks
• Robust Speech Recognition via Large-Scale Weak Supervision
• Quantum autoencoders for efficient compression of quantum data
• Early Convolutions Help Transformers See Better
• Listen, Attend and Spell
• Towards artificial general intelligence via a multimodal foundation model
• Adversarial Attacks on Deep Learning Models in Natural Language Processing: A Survey
• Consciousness in Artificial Intelligence: Insights from the Science of Consciousness
• Active learning for data streams: a survey
• Adversarial Images for Variational Autoencoders
• Large Language Models for Data Annotation and Synthesis: A Survey
• Explainable Knowledge Distillation for On-device Chest X-Ray Classification
• Feature-aware conditional GAN for category text generation
• When Robots Get Chatty: Grounding Multimodal Human-Robot Conversation and Collaboration
• Towards Better Chinese-centric Neural Machine Translation for Low-resource Languages
• OWAdapt: An adaptive loss function for deep learning using OWA operators
• Neuro-Symbolic AI in 2024: A Systematic Review
• Tuning Fairness by Balancing Target Labels
• WSense: A Robust Feature Learning Module for Lightweight Human Activity Recognition
• Improving Word Sense Disambiguation in Neural Machine Translation with Salient Document Context
• I Can Tell What I am Doing: Toward Real-World Natural Language Grounding of Robot Experiences
• ECG-SleepNet: Deep Learning-Based Comprehensive Sleep Stage Classification Using ECG Signals
• SYNERGAI: Perception Alignment for Human-Robot Collaboration
• Transformer Based Time-Series Forecasting for Stock
• Samba-ASR: State-Of-The-Art Speech Recognition Leveraging Structured State-Space Models
• Aligner-Encoders: Self-Attention Transformers Can Be Self-Transducers
• Deep EEG Super-Resolution: Upsampling EEG Spatial Resolution with Generative Adversarial Networks