Phase Retrieval using Expectation Consistent Signal Recovery Algorithm based on Hypernetwork

Abstract

Phase retrieval (PR) is an important component in modern computational imaging systems. Many algorithms have been developed over the past half-century. Recent advances in deep learning have introduced new possibilities for a robust and fast PR. An emerging technique called deep unfolding provides a systematic connection between conventional model-based iterative algorithms and modern data-based deep learning. Unfolded algorithms, which are powered by data learning, have shown remarkable performance and convergence speed improvement over original algorithms. Despite their potential, most existing unfolded algorithms are strictly confined to a fixed number of iterations when layer-dependent parameters are used. In this study, we develop a novel framework for deep unfolding to overcome existing limitations. Our development is based on an unfolded generalized expectation consistent signal recovery (GEC-SR) algorithm, wherein damping factors are left for data-driven learning. In particular, we introduce a hypernetwork to generate the damping factors for GEC-SR. Instead of learning a set of optimal damping factors directly, the hypernetwork learns how to generate the optimal damping factors according to the clinical settings, thereby ensuring its adaptivity to different scenarios. To enable the hypernetwork to adapt to varying layer numbers, we use a recurrent architecture to develop a dynamic hypernetwork that generates a damping factor that can vary online across layers. We also exploit a self-attention mechanism to enhance the robustness of the hypernetwork. Extensive experiments show that the proposed algorithm outperforms existing ones in terms of convergence speed and accuracy and still works well under very harsh settings, even under which many classical PR algorithms are unstable.

arXiv comment14 pages, 9 figures, accepted in IEEE Transactions on Signal Processing

References in corpus (20)

• Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling
• Expectation Propagation for approximate Bayesian inference
• Trainable Nonlinear Reaction Diffusion: A Flexible Framework for Fast and Effective Image Restoration
• Phase recovery and holographic image reconstruction using deep learning in neural networks
• Phase Retrieval via Wirtinger Flow: Theory and Algorithms
• Learned Primal-dual Reconstruction
• AMP-Inspired Deep Networks for Sparse Linear Inverse Problems
• Model-Driven Deep Learning for MIMO Detection
• Compressive Phase Retrieval via Generalized Approximate Message Passing
• Trainable ISTA for Sparse Signal Recovery
• Learned D-AMP: Principled Neural Network based Compressive Image Recovery
• Turbo Compressed Sensing with Partial DFT Sensing Matrix
• Fourier ptychographic reconstruction using Wirtinger flow optimization
• Theoretical Linear Convergence of Unfolded ISTA and its Practical Weights and Thresholds
• Unrolled Optimization with Deep Priors
• A Unified Bayesian Inference Framework for Generalized Linear Models
• Phase Retrieval Via Reweighted Wirtinger Flow
• Robust phase retrieval with the swept approximate message passing (prSAMP) algorithm
• Inverse Problems, Deep Learning, and Symmetry Breaking
• TARM: A Turbo-type Algorithm for Affine Rank Minimization