Deep Learning for Fine-Grained Image Analysis: A Survey

Abstract

Computer vision (CV) is the process of using machines to understand and analyze imagery, which is an integral branch of artificial intelligence. Among various research areas of CV, fine-grained image analysis (FGIA) is a longstanding and fundamental problem, and has become ubiquitous in diverse real-world applications. The task of FGIA targets analyzing visual objects from subordinate categories, \eg, species of birds or models of cars. The small inter-class variations and the large intra-class variations caused by the fine-grained nature makes it a challenging problem. During the booming of deep learning, recent years have witnessed remarkable progress of FGIA using deep learning techniques. In this paper, we aim to give a survey on recent advances of deep learning based FGIA techniques in a systematic way. Specifically, we organize the existing studies of FGIA techniques into three major categories: fine-grained image recognition, fine-grained image retrieval and fine-grained image generation. In addition, we also cover some other important issues of FGIA, such as publicly available benchmark datasets and its related domain specific applications. Finally, we conclude this survey by highlighting several directions and open problems which need be further explored by the community in the future.

Project page: http://www.weixiushen.com/project/Awesome_FGIA/Awesome_FGIA.html. arXiv admin note: text overlap with arXiv:1902.06068 by other authors

References in corpus (5)

• Neural Architecture Search: A Survey
• Fine-Grained Visual Classification of Aircraft
• Piecewise classifier mappings: Learning fine-grained learners for novel categories with few examples
• RPC: A Large-Scale Retail Product Checkout Dataset
• Maximum-Entropy Fine-Grained Classification

Cited by in corpus (14)

• BBN: Bilateral-Branch Network with Cumulative Learning for Long-Tailed Visual Recognition
• Fine-Grained Fashion Similarity Prediction by Attribute-Specific Embedding Learning
• Classification of retail products: From probabilistic ranking to neural networks
• ISIA Food-500: A Dataset for Large-Scale Food Recognition via Stacked Global-Local Attention Network
• Deep Neural Networks Fused with Textures for Image Classification
• Evaluation of Various Open-Set Medical Imaging Tasks with Deep Neural Networks
• Self-Supervised Learning for Fine-Grained Visual Categorization
• Your "Flamingo" is My "Bird": Fine-Grained, or Not
• Towards Fine-grained Visual Representations by Combining Contrastive Learning with Image Reconstruction and Attention-weighted Pooling
• Multiscale Attention Guided Network for COVID-19 Diagnosis Using Chest X-ray Images
• Materials In Paintings (MIP): An interdisciplinary dataset for perception, art history, and computer vision
• Not All Negatives are Equal: Label-Aware Contrastive Loss for Fine-grained Text Classification
• Tips and Tricks for Webly-Supervised Fine-Grained Recognition: Learning from the WebFG 2020 Challenge
• MGD-GAN: Text-to-Pedestrian generation through Multi-Grained Discrimination