Trans-dimensional Hamiltonian model selection and parameter estimation from sparse, noisy data

Abstract

High-throughput characterization often requires estimating parameters and model dimension from experimental data of limited quantity and quality. Such data may result in an ill-posed inverse problem, where multiple sets of parameters and model dimensions are consistent with available data. This ill-posed regime may render traditional machine learning and deterministic methods unreliable or intractable, particularly in high-dimensional, nonlinear, and mixed continuous and discrete parameter spaces. To address these challenges, we present a Bayesian framework that hybridizes several Markov chain Monte Carlo (MCMC) sampling techniques to estimate both parameters and model dimension from sparse, noisy data. By integrating sampling for mixed continuous and discrete parameter spaces, reversible-jump MCMC to estimate model dimension, and parallel tempering to accelerate exploration of complex posteriors, our approach enables principled parameter estimation and model selection in data-limited regimes. We apply our framework to a specific ill-posed problem in quantum information science: recovering the locations and hyperfine couplings of nuclear spins surrounding a spin-defect in a semiconductor from sparse, noisy coherence data. We show that a hybridized MCMC method can recover meaningful posterior distributions over physical parameters using an order of magnitude less data than existing approaches, and we validate our results on experimental measurements. More generally, our work provides a flexible, extensible strategy for solving a broad class of ill-posed inverse problems under realistic experimental constraints.

31 pages, 5 figures

References in corpus (29)

• The No-U-Turn Sampler: Adaptively Setting Path Lengths in Hamiltonian Monte Carlo
• Universal control and error correction in multi-qubit spin registers in diamond
• Detection and control of individual nuclear spins using a weakly coupled electron spin
• Dynamic temperature selection for parallel-tempering in Markov chain Monte Carlo simulations
• Atomic-scale imaging of a 27-nuclear-spin cluster using a single-spin quantum sensor
• Repeated quantum error correction on a continuously encoded qubit by real-time feedback
• Entanglement and control of single quantum memories in isotopically engineered silicon carbide
• Machine-learned multi-system surrogate models for materials prediction
• High-Resolution Correlation Spectroscopy of 13C Spins Near a Nitrogen-Vacancy Center in Diamond
• Constraining Formation Models of Binary Black Holes with Gravitational-Wave Observations
• Sample-efficient learning of quantum many-body systems
• High resolution spectroscopy of single NV defects coupled with nearby ${}^{13}$C nuclear spins in diamond
• Materials challenges for quantum technologies based on color centers in diamond
• Learning many-body Hamiltonians with Heisenberg-limited scaling
• Mapping a 50-spin-qubit network through correlated sensing
• Robust and Efficient Hamiltonian Learning
• Deep learning enhanced individual nuclear-spin detection
• Dynamical suppression of fluctuations in an interacting nuclear spin bath of a self-assembled quantum dot using multiple pulse nuclear magnetic resonance
• Roadmap on Nanoscale Magnetic Resonance Imaging
• Is there an excess of black holes around $20M_{\odot }$? Optimising the complexity of population models with the use of reversible jump MCMC
• Finite-error metrological bounds on the multi-parameter Hamiltonian estimation
• Optimal Transport for Seismic Full Waveform Inversion
• Precise high-fidelity electron-nuclear spin entangling gates in NV centers via hybrid dynamical decoupling sequences
• Building Surrogate Models of Nuclear Density Functional Theory with Gaussian Processesand Autoencoders
• Controlled Spalling of Single Crystal 4H-SiC Bulk Substrates
• Algorithmic decomposition for efficient multiple nuclear spin detection in diamond
• Automatic Detection of Nuclear Spins at Arbitrary Magnetic Fields via Signal-to-Image AI Model
• A First Course in Monte Carlo Methods
• Stabilizing black-box model selection with the inflated argmax