Untrained Graph Neural Networks for Denoising

Abstract

A fundamental problem in signal processing is to denoise a signal. While there are many well-performing methods for denoising signals defined on regular supports, such as images defined on two-dimensional grids of pixels, many important classes of signals are defined over irregular domains such as graphs. This paper introduces two untrained graph neural network architectures for graph signal denoising, provides theoretical guarantees for their denoising capabilities in a simple setup, and numerically validates the theoretical results in more general scenarios. The two architectures differ on how they incorporate the information encoded in the graph, with one relying on graph convolutions and the other employing graph upsampling operators based on hierarchical clustering. Each architecture implements a different prior over the targeted signals. To numerically illustrate the validity of the theoretical results and to compare the performance of the proposed architectures with other denoising alternatives, we present several experimental results with real and synthetic datasets.

References in corpus (18)

• A Comprehensive Survey on Graph Neural Networks
• Cooperative Game Theory Approaches for Network Partitioning
• The Emerging Field of Signal Processing on Graphs: Extending High-Dimensional Data Analysis to Networks and Other Irregular Domains
• Geometric deep learning: going beyond Euclidean data
• Discrete Signal Processing on Graphs
• Growing Scale-Free Networks with Tunable Clustering
• Deep Image Prior
• Discrete Signal Processing on Graphs: Sampling Theory
• Convolutional Neural Network Architectures for Signals Supported on Graphs
• Graph Laplacian Regularization for Image Denoising: Analysis in the Continuous Domain
• Toward Deeper Understanding of Neural Networks: The Power of Initialization and a Dual View on Expressivity
• Deep Decoder: Concise Image Representations from Untrained Non-convolutional Networks
• Signal Processing on Higher-Order Networks: Livin' on the Edge ... and Beyond
• Graph Unrolling Networks: Interpretable Neural Networks for Graph Signal Denoising
• Denoising and Regularization via Exploiting the Structural Bias of Convolutional Generators
• DeepRED: Deep Image Prior Powered by RED
• Blind identification of stochastic block models from dynamical observations
• An Underparametrized Deep Decoder Architecture for Graph Signals