PlantPlotGAN: A Physics-Informed Generative Adversarial Network for Plant Disease Prediction

Abstract

Monitoring plantations is crucial for crop management and producing healthy harvests. Unmanned Aerial Vehicles (UAVs) have been used to collect multispectral images that aid in this monitoring. However, given the number of hectares to be monitored and the limitations of flight, plant disease signals become visually clear only in the later stages of plant growth and only if the disease has spread throughout a significant portion of the plantation. This limited amount of relevant data hampers the prediction models, as the algorithms struggle to generalize patterns with unbalanced or unrealistic augmented datasets effectively. To address this issue, we propose PlantPlotGAN, a physics-informed generative model capable of creating synthetic multispectral plot images with realistic vegetation indices. These indices served as a proxy for disease detection and were used to evaluate if our model could help increase the accuracy of prediction models. The results demonstrate that the synthetic imagery generated from PlantPlotGAN outperforms state-of-the-art methods regarding the Fréchet inception distance. Moreover, prediction models achieve higher accuracy metrics when trained with synthetic and original imagery for earlier plant disease detection compared to the training processes based solely on real imagery.

arXiv commentAccepted in IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), 2024

References in corpus (5)

• Adam: A Method for Stochastic Optimization
• CovidGAN: Data Augmentation Using Auxiliary Classifier GAN for Improved Covid-19 Detection
• Selective Synthetic Augmentation with HistoGAN for Improved Histopathology Image Classification
• Multi-Spectral Image Synthesis for Crop/Weed Segmentation in Precision Farming
• Self-supervised Learning for Panoptic Segmentation of Multiple Fruit Flower Species