Rain Streak Removal for Single Image via Kernel Guided CNN

Abstract

Rain streak removal is an important issue and has recently been investigated extensively. Existing methods, especially the newly emerged deep learning methods, could remove the rain streaks well in many cases. However the essential factor in the generative procedure of the rain streaks, i.e., the motion blur, which leads to the line pattern appearances, were neglected by the deep learning rain streaks approaches and this resulted in over-derain or under-derain results. In this paper, we propose a novel rain streak removal approach using a kernel guided convolutional neural network (KGCNN), achieving the state-of-the-art performance with simple network architectures. We first model the rain streak interference with its motion blur mechanism. Then, our framework starts with learning the motion blur kernel, which is determined by two factors including angle and length, by a plain neural network, denoted as parameter net, from a patch of the texture component. Then, after a dimensionality stretching operation, the learned motion blur kernel is stretched into a degradation map with the same spatial size as the rainy patch. The stretched degradation map together with the texture patch is subsequently input into a derain convolutional network, which is a typical ResNet architecture and trained to output the rain streaks with the guidance of the learned motion blur kernel. Experiments conducted on extensive synthetic and real data demonstrate the effectiveness of the proposed method, which preserves the texture and the contrast while removing the rain streaks.

References in corpus (6)

• Adam: A Method for Stochastic Optimization
• Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
• Gradient Magnitude Similarity Deviation: A Highly Efficient Perceptual Image Quality Index
• Clearing the Skies: A deep network architecture for single-image rain removal
• FastDeRain: A Novel Video Rain Streak Removal Method Using Directional Gradient Priors
• Rain Removal in Traffic Surveillance: Does it Matter?

Cited by in corpus (5)

• Image De-raining Using a Conditional Generative Adversarial Network
• A Survey on Rain Removal from Video and Single Image
• Unsupervised Single Image Deraining with Self-supervised Constraints
• MBA-RainGAN: Multi-branch Attention Generative Adversarial Network for Mixture of Rain Removal from Single Images
• Salt and pepper noise removal method based on stationary Framelet transform with non-convex sparsity regularization