Flexible statistical inference for mechanistic models of neural dynamics

Abstract

Mechanistic models of single-neuron dynamics have been extensively studied in computational neuroscience. However, identifying which models can quantitatively reproduce empirically measured data has been challenging. We propose to overcome this limitation by using likelihood-free inference approaches (also known as Approximate Bayesian Computation, ABC) to perform full Bayesian inference on single-neuron models. Our approach builds on recent advances in ABC by learning a neural network which maps features of the observed data to the posterior distribution over parameters. We learn a Bayesian mixture-density network approximating the posterior over multiple rounds of adaptively chosen simulations. Furthermore, we propose an efficient approach for handling missing features and parameter settings for which the simulator fails, as well as a strategy for automatically learning relevant features using recurrent neural networks. On synthetic data, our approach efficiently estimates posterior distributions and recovers ground-truth parameters. On in-vitro recordings of membrane voltages, we recover multivariate posteriors over biophysical parameters, which yield model-predicted voltage traces that accurately match empirical data. Our approach will enable neuroscientists to perform Bayesian inference on complex neuron models without having to design model-specific algorithms, closing the gap between mechanistic and statistical approaches to single-neuron modelling.

arXiv commentNIPS 2017. The first two authors contributed equally

References in corpus (8)

• Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling
• Adaptive approximate Bayesian computation
• Non-linear regression models for Approximate Bayesian Computation
• A Comparative Review of Dimension Reduction Methods in Approximate Bayesian Computation
• Accelerating ABC methods using Gaussian processes
• Variational Bayes with Synthetic Likelihood
• Neural Adaptive Sequential Monte Carlo
• Bayesian latent structure discovery from multi-neuron recordings

Cited by in corpus (29)

• The frontier of simulation-based inference
• Mining gold from implicit models to improve likelihood-free inference
• Mining for Dark Matter Substructure: Inferring subhalo population properties from strong lenses with machine learning
• Sequential Neural Likelihood: Fast Likelihood-free Inference with Autoregressive Flows
• Fast and Credible Likelihood-Free Cosmology with Truncated Marginal Neural Ratio Estimation
• Real-time gravitational-wave inference for binary neutron stars using machine learning
• Conditional Density Estimation Tools in Python and R with Applications to Photometric Redshifts and Likelihood-Free Cosmological Inference
• ABC-CDE: Towards Approximate Bayesian Computation with Complex High-Dimensional Data and Limited Simulations
• Black-box Bayesian inference for economic agent-based models
• Variational Bayesian Monte Carlo with Noisy Likelihoods
• Likelihood-free MCMC with Amortized Approximate Ratio Estimators
• Flexible distribution-free conditional predictive bands using density estimators
• Neural parameters estimation for brain tumor growth modeling
• Neural Approximate Sufficient Statistics for Implicit Models
• One never walks alone: the effect of the perturber population on subhalo measurements in strong gravitational lenses
• Being Bayesian in the 2020s: opportunities and challenges in the practice of modern applied Bayesian statistics
• Some models are useful, but how do we know which ones? Towards a unified Bayesian model taxonomy
• Accurate X-ray Timing in the Presence of Systematic Biases With Simulation-Based Inference
• Multifidelity multilevel Monte Carlo to accelerate approximate Bayesian parameter inference for partially observed stochastic processes
• Likelihood-free Forward Modeling for Cluster Weak Lensing and Cosmology
• Sequential Neural Posterior and Likelihood Approximation
• Sequential Neural Methods for Likelihood-free Inference
• Guided sequential ABC schemes for intractable Bayesian models
• Observational constraints using Bayesian statistics and Deep Learning in $f(Q)$ gravity
• HNPE: Leveraging Global Parameters for Neural Posterior Estimation
• Gradient-based Bayesian Experimental Design for Implicit Models using Mutual Information Lower Bounds
• A review of Approximate Bayesian Computation methods via density estimation: inference for simulator-models
• Fitting summary statistics of neural data with a differentiable spiking network simulator
• MINIMALIST: Mutual INformatIon Maximization for Amortized Likelihood Inference from Sampled Trajectories