Backbones-Review: Feature Extraction Networks for Deep Learning and Deep Reinforcement Learning Approaches

Abstract

To understand the real world using various types of data, Artificial Intelligence (AI) is the most used technique nowadays. While finding the pattern within the analyzed data represents the main task. This is performed by extracting representative features step, which is proceeded using the statistical algorithms or using some specific filters. However, the selection of useful features from large-scale data represented a crucial challenge. Now, with the development of convolution neural networks (CNNs), the feature extraction operation has become more automatic and easier. CNNs allow to work on large-scale size of data, as well as cover different scenarios for a specific task. For computer vision tasks, convolutional networks are used to extract features also for the other parts of a deep learning model. The selection of a suitable network for feature extraction or the other parts of a DL model is not random work. So, the implementation of such a model can be related to the target task as well as the computational complexity of it. Many networks have been proposed and become the famous networks used for any DL models in any AI task. These networks are exploited for feature extraction or at the beginning of any DL model which is named backbones. A backbone is a known network trained in many other tasks before and demonstrates its effectiveness. In this paper, an overview of the existing backbones, e.g. VGGs, ResNets, DenseNet, etc, is given with a detailed description. Also, a couple of computer vision tasks are discussed by providing a review of each task regarding the backbones used. In addition, a comparison in terms of performance is also provided, based on the backbone used for each task.

References in corpus (19)

• Very Deep Convolutional Networks for Large-Scale Image Recognition
• Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
• YOLOv4: Optimal Speed and Accuracy of Object Detection
• Transformers in Vision: A Survey
• Covid-19: Automatic detection from X-Ray images utilizing Transfer Learning with Convolutional Neural Networks
• Can AI help in screening Viral and COVID-19 pneumonia?
• COVIDX-Net: A Framework of Deep Learning Classifiers to Diagnose COVID-19 in X-Ray Images
• A modified deep convolutional neural network for detecting COVID-19 and pneumonia from chest X-ray images based on the concatenation of Xception and ResNet50V2
• COVID-ResNet: A Deep Learning Framework for Screening of COVID19 from Radiographs
• Deep High-Resolution Representation Learning for Visual Recognition
• Beyond Skip Connections: Top-Down Modulation for Object Detection
• DetNet: A Backbone network for Object Detection
• SCAR: Spatial-/Channel-wise Attention Regression Networks for Crowd Counting
• Low-resolution Face Recognition in the Wild via Selective Knowledge Distillation
• Deep Convolutional Neural Networks to Diagnose COVID-19 and other Pneumonia Diseases from Posteroanterior Chest X-Rays
• Scaling Wide Residual Networks for Panoptic Segmentation
• Deep Learning in Diabetic Foot Ulcers Detection: A Comprehensive Evaluation
• Single-shot Path Integrated Panoptic Segmentation
• Unifying Instance and Panoptic Segmentation with Dynamic Rank-1 Convolutions

Cited by in corpus (2)

• Transformer-based Image and Video Inpainting: Current Challenges and Future Directions
• FlightScope: An Experimental Comparative Review of Aircraft Detection Algorithms in Satellite Imagery