$P^2$ Net: Augmented Parallel-Pyramid Net for Attention Guided Pose Estimation

Abstract

We propose an augmented Parallel-Pyramid Net ($P^{2}Net$) with feature refinement by dilated bottleneck and attention module. During data preprocessing, we proposed a differentiable auto data augmentation ($D{A}^2$) method. We formulate the problem of searching data augmentaion policy in a differentiable form, so that the optimal policy setting can be easily updated by back propagation during training. $D{A}^2$ improves the training efficiency. A parallel-pyramid structure is followed to compensate the information loss introduced by the network. We innovate two fusion structures, i.e. Parallel Fusion and Progressive Fusion, to process pyramid features from backbone network. Both fusion structures leverage the advantages of spatial information affluence at high resolution and semantic comprehension at low resolution effectively. We propose a refinement stage for the pyramid features to further boost the accuracy of our network. By introducing dilated bottleneck and attention module, we increase the receptive field for the features with limited complexity and tune the importance to different feature channels. To further refine the feature maps after completion of feature extraction stage, an Attention Module ($AM$) is defined to extract weighted features from different scale feature maps generated by the parallel-pyramid structure. Compared with the traditional up-sampling refining, $AM$ can better capture the relationship between channels. Experiments corroborate the effectiveness of our proposed method. Notably, our method achieves the best performance on the challenging MSCOCO and MPII datasets.

arXiv commentAccepted by ICPR2020. arXiv admin note: text overlap with arXiv:2003.07516

References in corpus (12)

• Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
• Categorical Reparameterization with Gumbel-Softmax
• Squeeze-and-Excitation Networks
• Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computation
• The Concrete Distribution: A Continuous Relaxation of Discrete Random Variables
• AutoAugment: Learning Augmentation Policies from Data
• Associative Embedding: End-to-End Learning for Joint Detection and Grouping
• DetNet: A Backbone network for Object Detection
• Scale-Aware Trident Networks for Object Detection
• Deep High-Resolution Representation Learning for Human Pose Estimation
• Fast AutoAugment
• Online Hyper-parameter Learning for Auto-Augmentation Strategy