Self-supervised Learning for Panoptic Segmentation of Multiple Fruit Flower Species

Abstract

Convolutional neural networks trained using manually generated labels are commonly used for semantic or instance segmentation. In precision agriculture, automated flower detection methods use supervised models and post-processing techniques that may not perform consistently as the appearance of the flowers and the data acquisition conditions vary. We propose a self-supervised learning strategy to enhance the sensitivity of segmentation models to different flower species using automatically generated pseudo-labels. We employ a data augmentation and refinement approach to improve the accuracy of the model predictions. The augmented semantic predictions are then converted to panoptic pseudo-labels to iteratively train a multi-task model. The self-supervised model predictions can be refined with existing post-processing approaches to further improve their accuracy. An evaluation on a multi-species fruit tree flower dataset demonstrates that our method outperforms state-of-the-art models without computationally expensive post-processing steps, providing a new baseline for flower detection applications.

arXiv comment8 pages, 7 figures

References in corpus (7)

• YOLOv4: Optimal Speed and Accuracy of Object Detection
• The Effectiveness of Data Augmentation in Image Classification using Deep Learning
• Aleatoric uncertainty estimation with test-time augmentation for medical image segmentation with convolutional neural networks
• Universal Domain Adaptation through Self Supervision
• Multispecies fruit flower detection using a refined semantic segmentation network
• Where are the Masks: Instance Segmentation with Image-level Supervision
• Unsupervised Spatio-temporal Latent Feature Clustering for Multiple-object Tracking and Segmentation

Cited by in corpus (4)

• Weakly and Semi-Supervised Detection, Segmentation and Tracking of Table Grapes with Limited and Noisy Data
• Design, Integration, and Field Evaluation of a Robotic Blossom Thinning System for Tree Fruit Crops
• PlantPlotGAN: A Physics-Informed Generative Adversarial Network for Plant Disease Prediction
• Review of Fruit Tree Image Segmentation