A New Dataset, Poisson GAN and AquaNet for Underwater Object Grabbing
arXiv:2003.01446 · doi:10.1109/TCSVT.2021.3100059
Abstract
To boost the object grabbing capability of underwater robots for open-sea farming, we propose a new dataset (UDD) consisting of three categories (seacucumber, seaurchin, and scallop) with 2,227 images. To the best of our knowledge, it is the first 4K HD dataset collected in a real open-sea farm. We also propose a novel Poisson-blending Generative Adversarial Network (Poisson GAN) and an efficient object detection network (AquaNet) to address two common issues within related datasets: the class-imbalance problem and the problem of mass small object, respectively. Specifically, Poisson GAN combines Poisson blending into its generator and employs a new loss called Dual Restriction loss (DR loss), which supervises both implicit space features and image-level features during training to generate more realistic images. By utilizing Poisson GAN, objects of minority class like seacucumber or scallop could be added into an image naturally and annotated automatically, which could increase the loss of minority classes during training detectors to eliminate the class-imbalance problem; AquaNet is a high-efficiency detector to address the problem of detecting mass small objects from cloudy underwater pictures. Within it, we design two efficient components: a depth-wise-convolution-based Multi-scale Contextual Features Fusion (MFF) block and a Multi-scale Blursampling (MBP) module to reduce the parameters of the network to 1.3 million. Both two components could provide multi-scale features of small objects under a short backbone configuration without any loss of accuracy. In addition, we construct a large-scale augmented dataset (AUDD) and a pre-training dataset via Poisson GAN from UDD. Extensive experiments show the effectiveness of the proposed Poisson GAN, AquaNet, UDD, AUDD, and pre-training dataset.
arXiv comment14 pages, 10 figures
References in corpus (15)
- Adam: A Method for Stochastic Optimization
- SMOTE: Synthetic Minority Over-sampling Technique
- mixup: Beyond Empirical Risk Minimization
- Res2Net: A New Multi-scale Backbone Architecture
- Improved Regularization of Convolutional Neural Networks with Cutout
- Random Erasing Data Augmentation
- Wasserstein GAN
- U-GAT-IT: Unsupervised Generative Attentional Networks with Adaptive Layer-Instance Normalization for Image-to-Image Translation
- Making Convolutional Networks Shift-Invariant Again
- Lookahead Optimizer: k steps forward, 1 step back
- MixConv: Mixed Depthwise Convolutional Kernels
- FreeAnchor: Learning to Match Anchors for Visual Object Detection
- GridMask Data Augmentation
- User-Guided Deep Anime Line Art Colorization with Conditional Adversarial Networks
- Reveal of Domain Effect: How Visual Restoration Contributes to Object Detection in Aquatic Scenes