Learning Independent Instance Maps for Crowd Localization

Abstract

Accurately locating each head's position in the crowd scenes is a crucial task in the field of crowd analysis. However, traditional density-based methods only predict coarse prediction, and segmentation/detection-based methods cannot handle extremely dense scenes and large-range scale-variations crowds. To this end, we propose an end-to-end and straightforward framework for crowd localization, named Independent Instance Map segmentation (IIM). Different from density maps and boxes regression, each instance in IIM is non-overlapped. By segmenting crowds into independent connected components, the positions and the crowd counts (the centers and the number of components, respectively) are obtained. Furthermore, to improve the segmentation quality for different density regions, we present a differentiable Binarization Module (BM) to output structured instance maps. BM brings two advantages into localization models: 1) adaptively learn a threshold map for different images to detect each instance more accurately; 2) directly train the model using loss on binary predictions and labels. Extensive experiments verify the proposed method is effective and outperforms the-state-of-the-art methods on the five popular crowd datasets. Significantly, IIM improves F1-measure by 10.4% on the NWPU-Crowd Localization task. The source code and pre-trained models will be released at https://github.com/taohan10200/IIM.

References in corpus (6)

• Very Deep Convolutional Networks for Large-Scale Image Recognition
• High-Resolution Representations for Labeling Pixels and Regions
• Fully Convolutional Neural Networks for Crowd Segmentation
• PyramidBox++: High Performance Detector for Finding Tiny Face
• C^3 Framework: An Open-source PyTorch Code for Crowd Counting
• Localization in the Crowd with Topological Constraints

Cited by in corpus (6)

• Focal Inverse Distance Transform Maps for Crowd Localization
• Counting Varying Density Crowds Through Density Guided Adaptive Selection CNN and Transformer Estimation
• Crowd Localization from Gaussian Mixture Scoped Knowledge and Scoped Teacher
• Learning Discriminative Features for Crowd Counting
• LDC-Net: A Unified Framework for Localization, Detection and Counting in Dense Crowds
• Audio-visual Representation Learning for Anomaly Events Detection in Crowds