FastDeRain: A Novel Video Rain Streak Removal Method Using Directional Gradient Priors

Abstract

Rain streak removal is an important issue in outdoor vision systems and has recently been investigated extensively. In this paper, we propose a novel video rain streak removal approach FastDeRain, which fully considers the discriminative characteristics of rain streaks and the clean video in the gradient domain. Specifically, on the one hand, rain streaks are sparse and smooth along the direction of the raindrops, whereas on the other hand, clean videos exhibit piecewise smoothness along the rain-perpendicular direction and continuity along the temporal direction. Theses smoothness and continuity results in the sparse distribution in the different directional gradient domain, respectively. Thus, we minimize 1) the ${\ell }_1$ norm to enhance the sparsity of the underlying rain streaks, 2) two ${\ell }_1$ norm of unidirectional Total Variation (TV) regularizers to guarantee the anisotropic spatial smoothness, and 3) an ${\ell }_1$ norm of the time-directional difference operator to characterize the temporal continuity. A split augmented Lagrangian shrinkage algorithm (SALSA) based algorithm is designed to solve the proposed minimization model. Experiments conducted on synthetic and real data demonstrate the effectiveness and efficiency of the proposed method. According to comprehensive quantitative performance measures, our approach outperforms other state-of-the-art methods especially on account of the running time. The code of FastDeRain can be downloaded at https://github.com/TaiXiangJiang/FastDeRain.

arXiv commentcodes available at https://github.com/TaiXiangJiang/FastDeRain

References in corpus (6)

• Gradient Magnitude Similarity Deviation: A Highly Efficient Perceptual Image Quality Index
• Clearing the Skies: A deep network architecture for single-image rain removal
• An Augmented Lagrangian Approach to the Constrained Optimization Formulation of Imaging Inverse Problems
• DesnowNet: Context-Aware Deep Network for Snow Removal
• Rain Removal in Traffic Surveillance: Does it Matter?
• Non-local tensor completion for multitemporal remotely sensed images inpainting

Cited by in corpus (15)

• Multi-dimensional imaging data recovery via minimizing the partial sum of tubal nuclear norm
• Rain Streak Removal for Single Image via Kernel Guided CNN
• A Survey on Rain Removal from Video and Single Image
• Confidence Measure Guided Single Image De-raining
• RainMamba: Enhanced Locality Learning with State Space Models for Video Deraining
• Deep-Masking Generative Network: A Unified Framework for Background Restoration from Superimposed Images
• Investigating Task-driven Latent Feasibility for Nonconvex Image Modeling
• Triple-level Model Inferred Collaborative Network Architecture for Video Deraining
• Progressive Image Deraining Networks: A Better and Simpler Baseline
• RCDNet: An Interpretable Rain Convolutional Dictionary Network for Single Image Deraining
• Semi-Supervised Video Deraining with Dynamical Rain Generator
• Neural Image Representations for Multi-Image Fusion and Layer Separation
• Tensor Restricted Isometry Property Analysis For a Large Class of Random Measurement Ensembles
• Let's See Clearly: Contaminant Artifact Removal for Moving Cameras
• Investigating Customization Strategies and Convergence Behaviors of Task-specific ADMM