Estimating Nuisance Parameters in Inverse Problems
arXiv:1206.6532 · doi:10.1088/0266-5611/28/11/115016
Abstract
Many inverse problems include nuisance parameters which, while not of direct interest, are required to recover primary parameters. Structure present in these problems allows efficient optimization strategies - a well known example is variable projection, where nonlinear least squares problems which are linear in some parameters can be very efficiently optimized. In this paper, we extend the idea of projecting out a subset over the variables to a broad class of maximum likelihood (ML) and maximum a posteriori likelihood (MAP) problems with nuisance parameters, such as variance or degrees of freedom. As a result, we are able to incorporate nuisance parameter estimation into large-scale constrained and unconstrained inverse problem formulations. We apply the approach to a variety of problems, including estimation of unknown variance parameters in the Gaussian model, degree of freedom (d.o.f.) parameter estimation in the context of robust inverse problems, automatic calibration, and optimal experimental design. Using numerical examples, we demonstrate improvement in recovery of primary parameters for several large- scale inverse problems. The proposed approach is compatible with a wide variety of algorithms and formulations, and its implementation requires only minor modifications to existing algorithms.
16 pages, 5 figures
References in corpus (1)
Cited by in corpus (10)
- Sparse Principal Component Analysis via Variable Projection
- A penalty method for PDE-constrained optimization in inverse problems
- A constrained variable projection reconstruction method for photoacoustic computed tomography without accurate knowledge of transducer responses
- Numerical Approximation of Partial Differential Equations by a Variable Projection Method with Artificial Neural Networks
- A parametric level-set method for partially discrete tomography
- Efficient extended-search space full-waveform inversion with unknown source signatures
- Resolving Full-Wave Through-Wall Transmission Effects in Multi-Static Synthetic Aperture Radar
- Solution of an Acoustic Transmission Inverse Problem by Extended Inversion
- Adaptive minimax optimality in statistical inverse problems via SOLIT -- Sharp Optimal Lepskii-Inspired Tuning
- Automatic and Computationally Efficient Alignment in Fan- and Cone-beam Tomography