Multi-source Pseudo-label Learning of Semantic Segmentation for the Scene Recognition of Agricultural Mobile Robots

Abstract

This paper describes a novel method of training a semantic segmentation model for scene recognition of agricultural mobile robots exploiting publicly available datasets of outdoor scenes that are different from the target greenhouse environments. Semantic segmentation models require abundant labels given by tedious manual annotation. A method to work around it is unsupervised domain adaptation (UDA) that transfers knowledge from labeled source datasets to unlabeled target datasets. However, the effectiveness of existing methods is not well studied in adaptation between heterogeneous environments, such as urban scenes and greenhouses. In this paper, we propose a method to train a semantic segmentation model for greenhouse images without manually labeled datasets of greenhouse images. The core of our idea is to use multiple rich image datasets of different environments with segmentation labels to generate pseudo-labels for the target images to effectively transfer the knowledge from multiple sources and realize a precise training of semantic segmentation. Along with the pseudo-label generation, we introduce state-of-the-art methods to deal with noise in the pseudo-labels to further improve the performance. We demonstrate in experiments with multiple greenhouse datasets that our proposed method improves the performance compared to the single-source baselines and an existing approach.

arXiv commentPublished in Advanced Robotics

References in corpus (9)

• ADVENT: Adversarial Entropy Minimization for Domain Adaptation in Semantic Segmentation
• ENet: A Deep Neural Network Architecture for Real-Time Semantic Segmentation
• CyCADA: Cycle-Consistent Adversarial Domain Adaptation
• Unsupervised Scene Adaptation with Memory Regularization in vivo
• Multi-source Domain Adaptation for Semantic Segmentation
• Multi-source Domain Adaptation in the Deep Learning Era: A Systematic Survey
• Deep Semantic Segmentation at the Edge for Autonomous Navigation in Vineyard Rows
• A Review of Single-Source Deep Unsupervised Visual Domain Adaptation
• Image-based scene recognition for robot navigation considering traversable plants and its manual annotation-free training

Cited by in corpus (2)

• Image-based scene recognition for robot navigation considering traversable plants and its manual annotation-free training
• DeepIPC: Deeply Integrated Perception and Control for an Autonomous Vehicle in Real Environments