A Survey on Rain Removal from Video and Single Image

Abstract

Rain streaks might severely degenerate the performance of video/image processing tasks. The investigations on rain removal from video or a single image has thus been attracting much research attention in the field of computer vision and pattern recognition, and various methods have been proposed against this task in the recent years. However, there is still not a comprehensive survey paper to summarize current rain removal methods and fairly compare their generalization performance, and especially, still not a off-the-shelf toolkit to accumulate recent representative methods for easy performance comparison and capability evaluation. Aiming at this meaningful task, in this study we present a comprehensive review for current rain removal methods for video and a single image. Specifically, these methods are categorized into model-driven and data-driven approaches, and more elaborate branches of each approach are further introduced. Intrinsic capabilities, especially generalization, of representative state-of-the-art methods of each approach have been evaluated and analyzed by experiments implemented on synthetic and real data both visually and quantitatively. Furthermore, we release a comprehensive repository, including direct links to 74 rain removal papers, source codes of 9 methods for video rain removal and 20 ones for single image rain removal, 19 related project pages, 6 synthetic datasets and 4 real ones, and 4 commonly used image quality metrics, to facilitate reproduction and performance comparison of current existing methods for general users. Some limitations and research issues worthy to be further investigated have also been discussed for future research of this direction.

References in corpus (11)

• Clearing the Skies: A deep network architecture for single-image rain removal
• FastDeRain: A Novel Video Rain Streak Removal Method Using Directional Gradient Priors
• Rain Removal in Traffic Surveillance: Does it Matter?
• Rain Streak Removal for Single Image via Kernel Guided CNN
• Confidence Measure Guided Single Image De-raining
• Semi-supervised Transfer Learning for Image Rain Removal
• Residual-Guide Feature Fusion Network for Single Image Deraining
• Rain O'er Me: Synthesizing real rain to derain with data distillation
• Gradual Network for Single Image De-raining
• Multispectral and Hyperspectral Image Fusion by MS/HS Fusion Net
• Non-locally Enhanced Encoder-Decoder Network for Single Image De-raining

Cited by in corpus (11)

• ViGT: Proposal-free Video Grounding with Learnable Token in Transformer
• A Survey on All-in-One Image Restoration: Taxonomy, Evaluation and Future Trends
• Exploring Overcomplete Representations for Single Image Deraining using CNNs
• A Model-driven Deep Neural Network for Single Image Rain Removal
• DerainCycleGAN: Rain Attentive CycleGAN for Single Image Deraining and Rainmaking
• Single Image Deraining: From Model-Based to Data-Driven and Beyond
• Semi-DerainGAN: A New Semi-supervised Single Image Deraining Network
• RCDNet: An Interpretable Rain Convolutional Dictionary Network for Single Image Deraining
• Unfolding Taylor's Approximations for Image Restoration
• Semi-Supervised Video Deraining with Dynamical Rain Generator
• Image Deraining and Denoising Convolutional Neural Network ForAutonomous Driving