A Challenging Benchmark of Anime Style Recognition
arXiv:2204.14034 · doi:10.1109/CVPRW56347.2022.00518
Abstract
Given two images of different anime roles, anime style recognition (ASR) aims to learn abstract painting style to determine whether the two images are from the same work, which is an interesting but challenging problem. Unlike biometric recognition, such as face recognition, iris recognition, and person re-identification, ASR suffers from a much larger semantic gap but receives less attention. In this paper, we propose a challenging ASR benchmark. Firstly, we collect a large-scale ASR dataset (LSASRD), which contains 20,937 images of 190 anime works and each work at least has ten different roles. In addition to the large-scale, LSASRD contains a list of challenging factors, such as complex illuminations, various poses, theatrical colors and exaggerated compositions. Secondly, we design a cross-role protocol to evaluate ASR performance, in which query and gallery images must come from different roles to validate an ASR model is to learn abstract painting style rather than learn discriminative features of roles. Finally, we apply two powerful person re-identification methods, namely, AGW and TransReID, to construct the baseline performance on LSASRD. Surprisingly, the recent transformer model (i.e., TransReID) only acquires a 42.24% mAP on LSASRD. Therefore, we believe that the ASR task of a huge semantic gap deserves deep and long-term research. We will open our dataset and code at https://github.com/nkjcqvcpi/ASR.
accepted by CVPRW 2022
References in corpus (9)
- An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
- Grad-CAM++: Improved Visual Explanations for Deep Convolutional Networks
- When Does Label Smoothing Help?
- Training data-efficient image transformers & distillation through attention
- Freeze the Discriminator: a Simple Baseline for Fine-Tuning GANs
- Second-order Non-local Attention Networks for Person Re-identification
- Building a Manga Dataset "Manga109" with Annotations for Multimedia Applications
- Assessment of iris recognition reliability for eyes affected by ocular pathologies
- ACFD: Asymmetric Cartoon Face Detector