The Complex Gradient Operator and the CR-Calculus

Abstract

A thorough discussion and development of the calculus of real-valued functions of complex-valued vectors is given using the framework of the Wirtinger Calculus. The presented material is suitable for exposition in an introductory Electrical Engineering graduate level course on the use of complex gradients and complex Hessian matrices, and has been successfully used in teaching at UC San Diego. Going beyond the commonly encountered treatments of the first-order complex vector calculus, second-order considerations are examined in some detail filling a gap in the pedagogic literature.

Cited by in corpus (58)

• Implicit Regularization in Nonconvex Statistical Estimation: Gradient Descent Converges Linearly for Phase Retrieval, Matrix Completion, and Blind Deconvolution
• Real and Complex Monotone Communication Games
• Extension of Wirtinger's Calculus to Reproducing Kernel Hilbert Spaces and the Complex Kernel LMS
• Fundamental limits to optical response in absorptive systems
• Quaternion Gradient and Hessian
• The Theory of Quaternion Matrix Derivatives
• CubiCal - Fast radio interferometric calibration suite exploiting complex optimisation
• Quaternion Derivatives: The GHR Calculus
• Alternating Projection, Ptychographic Imaging and Phase Synchronization
• PtyLab.m/py/jl: a cross-platform, open-source inverse modeling toolbox for conventional and Fourier ptychography
• Power System State Estimation via Feasible Point Pursuit: Algorithms and Cramer-Rao Bound
• Functional Wigner representation of BEC quantum dynamics
• Semiparametric CRB and Slepian-Bangs formulas for Complex Elliptically Symmetric Distributions
• Leveraging Machine Learning to Alleviate Hubbard Model Sign Problems
• A general framework for constrained convex quaternion optimization
• Dynamic Independent Component/Vector Analysis: Time-Variant Linear Mixtures Separable by Time-Invariant Beamformers
• Solving (most) of a set of quadratic equalities: Composite optimization for robust phase retrieval
• Wirtinger's Calculus in general Hilbert Spaces
• Laser beam complex amplitude measurement by phase diversity
• Secrecy Analyses of a Full-Duplex MIMOME Network
• Quaternion Non-negative Matrix Factorization: definition, uniqueness and algorithm
• PSSE Redux: Convex Relaxation, Decentralized, Robust, and Dynamic Approaches
• ATASI-Net: An Efficient Sparse Reconstruction Network for Tomographic SAR Imaging with Adaptive Threshold
• Phase retrieval with Bregman divergences and application to audio signal recovery
• Stable Deep MRI Reconstruction using Generative Priors
• On the Computation of Complex-valued Gradients with Application to Statistically Optimum Beamforming
• Trace formulation for photonic inverse design with incoherent sources
• Compressed Sensing for Analog Signals
• Efficient approximation of Jacobian matrices involving a non-uniform fast Fourier transform (NUFFT)
• PINQI: An End-to-End Physics-Informed Approach to Learned Quantitative MRI Reconstruction
• Deep Learning for Waveform Estimation and Imaging in Passive Radar
• Conservation-law-based global bounds to quantum optimal control
• Robust Wavefield Inversion via Phase Retrieval
• Natural Gradient Optimization for Optical Quantum Circuits
• An Optimized Dynamic Mode Decomposition Model Robust to Multiplicative Noise
• Co-VeGAN: Complex-Valued Generative Adversarial Network for Compressive Sensing MR Image Reconstruction
• On Gradient Descent Algorithm for Generalized Phase Retrieval Problem
• Complex-valued Federated Learning with Differential Privacy and MRI Applications
• Subspace Phase Retrieval
• Model-based resonance tracking of linear systems
• Asynchronous Adaptation and Learning over Networks --- Part I: Modeling and Stability Analysis
• Reciprocal Adversarial Learning via Characteristic Functions
• Complex Unitary Recurrent Neural Networks using Scaled Cayley Transform
• Numerical Optimization Algorithm of Wavefront Phase Retrieval from Multiple Measurements
• On The Geometric Analysis of A Quartic-quadratic Optimization Problem under A Spherical Constraint
• General Phase Regularized Reconstruction using Phase Cycling
• Message-Passing Receiver for Joint Channel Estimation and Decoding in 3D Massive MIMO-OFDM Systems
• ${\ell }^p-{\ell }^q$-Norm Minimization for Joint Precoding and Peak-to-Average-Power Ratio Reduction
• Neural Networks with Complex-Valued Weights Have No Spurious Local Minima
• Constrained Best Linear Unbiased Estimation
• Newton's Method Backpropagation for Complex-Valued Holomorphic Multilayer Perceptrons
• Distributed Widely Linear Complex Kalman Filtering
• Joint Estimation of Location and Scatter in Complex Elliptical Distributions: A robust semiparametric and computationally efficient $R$-estimator of the shape matrix
• A matrix-free Levenberg-Marquardt algorithm for efficient ptychographic phase retrieval
• Widely Linear Kernels for Complex-Valued Kernel Activation Functions
• Scalable Incremental Nonconvex Optimization Approach for Phase Retrieval
• SAR Image Autofocusing using Wirtinger calculus and Cauchy regularization
• Widely Linear Complex-valued Autoencoder: Dealing with Noncircularity in Generative-Discriminative Models