Conditional Denoising of Remote Sensing Imagery Using Cycle-Consistent Deep Generative Models
arXiv:1910.14567
Abstract
The potential of using remote sensing imagery for environmental modelling and for providing real time support to humanitarian operations such as hurricane relief efforts is well established. These applications are substantially affected by missing data due to non-structural noise such as clouds, shadows and other atmospheric effects. In this work we probe the potential of applying a cycle-consistent latent variable deep generative model (DGM) for denoising cloudy Sentinel-2 observations conditioned on the information in cloud penetrating bands. We adapt the recently proposed Fréchet Distance metric to remote sensing images for evaluating performance of the generator, demonstrate the potential of DGMs for conditional denoising, and discuss future directions as well as the limitations of DGMs in Earth science and humanitarian applications.
Accepted NeurIPS AI for Social Good, 14 December 2019
References in corpus (6)
- GANs Trained by a Two Time-Scale Update Rule Converge to a Local Nash Equilibrium
- Large Scale GAN Training for High Fidelity Natural Image Synthesis
- BigEarthNet: A Large-Scale Benchmark Archive For Remote Sensing Image Understanding
- Augmented CycleGAN: Learning Many-to-Many Mappings from Unpaired Data
- Learning Visual Features from Large Weakly Supervised Data
- MultiNet: Segmenting Flooded Buildings via Fusion of Multiresolution, Multisensor, and Multitemporal Satellite Imagery