HNPE: Leveraging Global Parameters for Neural Posterior Estimation

Abstract

Inferring the parameters of a stochastic model based on experimental observations is central to the scientific method. A particularly challenging setting is when the model is strongly indeterminate, i.e. when distinct sets of parameters yield identical observations. This arises in many practical situations, such as when inferring the distance and power of a radio source (is the source close and weak or far and strong?) or when estimating the amplifier gain and underlying brain activity of an electrophysiological experiment. In this work, we present hierarchical neural posterior estimation (HNPE), a novel method for cracking such indeterminacy by exploiting additional information conveyed by an auxiliary set of observations sharing global parameters. Our method extends recent developments in simulation-based inference (SBI) based on normalizing flows to Bayesian hierarchical models. We validate quantitatively our proposal on a motivating example amenable to analytical solutions and then apply it to invert a well known non-linear model from computational neuroscience, using both simulated and real EEG data.

References in corpus (10)

• Adam: A Method for Stochastic Optimization
• The frontier of simulation-based inference
• MADE: Masked Autoencoder for Distribution Estimation
• Fast $\epsilon$-free Inference of Simulation Models with Bayesian Conditional Density Estimation
• Interpolating between Optimal Transport and MMD using Sinkhorn Divergences
• Flexible statistical inference for mechanistic models of neural dynamics
• Mining for Dark Matter Substructure: Inferring subhalo population properties from strong lenses with machine learning
• Automatic Posterior Transformation for Likelihood-Free Inference
• On Contrastive Learning for Likelihood-free Inference
• Learning summary features of time series for likelihood free inference

Cited by in corpus (4)

• Accurate X-ray Timing in the Presence of Systematic Biases With Simulation-Based Inference
• Neural Posterior Estimation for Cataloging Astronomical Images with Spatially Varying Backgrounds and Point Spread Functions
• STAR NRE: Solving supernova selection effects with set-based truncated auto-regressive neural ratio estimation
• Deep inference of simulated strong lenses in ground-based surveys