Rethinking Cross-Domain Pedestrian Detection: A Background-Focused Distribution Alignment Framework for Instance-Free One-Stage Detectors
arXiv:2309.08771 · doi:10.1109/TIP.2023.3307222
Abstract
Cross-domain pedestrian detection aims to generalize pedestrian detectors from one label-rich domain to another label-scarce domain, which is crucial for various real-world applications. Most recent works focus on domain alignment to train domain-adaptive detectors either at the instance level or image level. From a practical point of view, one-stage detectors are faster. Therefore, we concentrate on designing a cross-domain algorithm for rapid one-stage detectors that lacks instance-level proposals and can only perform image-level feature alignment. However, pure image-level feature alignment causes the foreground-background misalignment issue to arise, i.e., the foreground features in the source domain image are falsely aligned with background features in the target domain image. To address this issue, we systematically analyze the importance of foreground and background in image-level cross-domain alignment, and learn that background plays a more critical role in image-level cross-domain alignment. Therefore, we focus on cross-domain background feature alignment while minimizing the influence of foreground features on the cross-domain alignment stage. This paper proposes a novel framework, namely, background-focused distribution alignment (BFDA), to train domain adaptive onestage pedestrian detectors. Specifically, BFDA first decouples the background features from the whole image feature maps and then aligns them via a novel long-short-range discriminator.
arXiv commentThis paper published on IEEE Transactions on Image Processing on August 2023.See https://ieeexplore.ieee.org/document/10231122
References in corpus (8)
- An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
- SSD: Single Shot MultiBox Detector
- Rethinking Atrous Convolution for Semantic Image Segmentation
- PVT v2: Improved Baselines with Pyramid Vision Transformer
- Semantic Foggy Scene Understanding with Synthetic Data
- Harmonizing Transferability and Discriminability for Adapting Object Detectors
- Domain Adaptive YOLO for One-Stage Cross-Domain Detection
- Box Re-Ranking: Unsupervised False Positive Suppression for Domain Adaptive Pedestrian Detection