Effective Data Fusion with Generalized Vegetation Index: Evidence from Land Cover Segmentation in Agriculture
arXiv:2005.03743
Abstract
How can we effectively leverage the domain knowledge from remote sensing to better segment agriculture land cover from satellite images? In this paper, we propose a novel, model-agnostic, data-fusion approach for vegetation-related computer vision tasks. Motivated by the various Vegetation Indices (VIs), which are introduced by domain experts, we systematically reviewed the VIs that are widely used in remote sensing and their feasibility to be incorporated in deep neural networks. To fully leverage the Near-Infrared channel, the traditional Red-Green-Blue channels, and Vegetation Index or its variants, we propose a Generalized Vegetation Index (GVI), a lightweight module that can be easily plugged into many neural network architectures to serve as an additional information input. To smoothly train models with our GVI, we developed an Additive Group Normalization (AGN) module that does not require extra parameters of the prescribed neural networks. Our approach has improved the IoUs of vegetation-related classes by 0.9-1.3 percent and consistently improves the overall mIoU by 2 percent on our baseline.
arXiv commentCVPR 2020 - Vision for Agriculture; https://www.agriculture-vision.com
References in corpus (11)
- Adam: A Method for Stochastic Optimization
- Rethinking Atrous Convolution for Semantic Image Segmentation
- EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks
- Instance Normalization: The Missing Ingredient for Fast Stylization
- SGDR: Stochastic Gradient Descent with Warm Restarts
- Focal Loss for Dense Object Detection
- DeepGlobe 2018: A Challenge to Parse the Earth through Satellite Images
- Infrared and Visible Image Fusion using a Deep Learning Framework
- Batch-Instance Normalization for Adaptively Style-Invariant Neural Networks
- Agriculture-Vision: A Large Aerial Image Database for Agricultural Pattern Analysis
- Learning to Interpret Satellite Images in Global Scale Using Wikipedia