Variational Inference: A Review for Statisticians

Abstract

One of the core problems of modern statistics is to approximate difficult-to-compute probability densities. This problem is especially important in Bayesian statistics, which frames all inference about unknown quantities as a calculation involving the posterior density. In this paper, we review variational inference (VI), a method from machine learning that approximates probability densities through optimization. VI has been used in many applications and tends to be faster than classical methods, such as Markov chain Monte Carlo sampling. The idea behind VI is to first posit a family of densities and then to find the member of that family which is close to the target. Closeness is measured by Kullback-Leibler divergence. We review the ideas behind mean-field variational inference, discuss the special case of VI applied to exponential family models, present a full example with a Bayesian mixture of Gaussians, and derive a variant that uses stochastic optimization to scale up to massive data. We discuss modern research in VI and highlight important open problems. VI is powerful, but it is not yet well understood. Our hope in writing this paper is to catalyze statistical research on this class of algorithms.

References in corpus (16)

• Expectation Propagation for approximate Bayesian inference
• A correlated topic model of Science
• Markov Chain Monte Carlo and Variational Inference: Bridging the Gap
• A Bayesian Approach to Network Modularity
• Automatic Differentiation Variational Inference
• Describing disability through individual-level mixture models for multivariate binary data
• Variational Bayesian Inference with Stochastic Search
• Fast Variational Inference in the Conjugate Exponential Family
• Automated Variational Inference in Probabilistic Programming
• Computing Upper and Lower Bounds on Likelihoods in Intractable Networks
• Variational Gaussian Process Dynamical Systems
• Gaussian variational approximation with sparse precision matrices
• Asymptotic normality and valid inference for Gaussian variational approximation
• Stochastic Variational Inference for Hidden Markov Models
• Celeste: Variational inference for a generative model of astronomical images
• Variational Cumulant Expansions for Intractable Distributions

Cited by in corpus (409)

• A Review of Uncertainty Quantification in Deep Learning: Techniques, Applications and Challenges
• dynesty: A Dynamic Nested Sampling Package for Estimating Bayesian Posteriors and Evidences
• Hands-on Bayesian Neural Networks -- a Tutorial for Deep Learning Users
• Informed Machine Learning -- A Taxonomy and Survey of Integrating Knowledge into Learning Systems
• Bayesian Deep Convolutional Encoder-Decoder Networks for Surrogate Modeling and Uncertainty Quantification
• KalmanNet: Neural Network Aided Kalman Filtering for Partially Known Dynamics
• Using stacking to average Bayesian predictive distributions
• Uncertainty Quantification in Scientific Machine Learning: Methods, Metrics, and Comparisons
• Adversarial Uncertainty Quantification in Physics-Informed Neural Networks
• Uncertainty Quantification in Machine Learning for Engineering Design and Health Prognostics: A Tutorial
• Active inference on discrete state-spaces: a synthesis
• Bayesian Neural Networks: An Introduction and Survey
• Frequentist Consistency of Variational Bayes
• Graph Neural Networks: Taxonomy, Advances and Trends
• Physics-Informed Probabilistic Learning of Linear Embeddings of Non-linear Dynamics With Guaranteed Stability
• Active inference: demystified and compared
• MoRe-Fi: Motion-robust and Fine-grained Respiration Monitoring via Deep-Learning UWB Radar
• An Ensemble of Epoch-wise Empirical Bayes for Few-shot Learning
• On Bayesian Mechanics: A Physics of and by Beliefs
• Sampling using $SU(N)$ gauge equivariant flows
• A Survey on Neural Topic Models: Methods, Applications, and Challenges
• Machine Learning in Thermodynamics: Prediction of Activity Coefficients by Matrix Completion
• Inf-VAE: A Variational Autoencoder Framework to Integrate Homophily and Influence in Diffusion Prediction
• Bayesian Parameter Estimation for Dynamical Models in Systems Biology
• A Unified Statistical Framework for Single Cell and Bulk RNA Sequencing Data
• Modeling emotion in complex stories: the Stanford Emotional Narratives Dataset
• Seismic tomography using variational inference methods
• Audio-visual Speech Enhancement Using Conditional Variational Auto-Encoders
• Understanding Event-Generation Networks via Uncertainties
• Measuring and modeling the motor system with machine learning
• Generative Networks for Precision Enthusiasts
• An Ensemble of Bayesian Neural Networks for Exoplanetary Atmospheric Retrieval
• Bayesian delensing delight: sampling-based inference of the primordial CMB and gravitational lensing
• Valid prediction intervals for regression problems
• Variational Bayes for high-dimensional linear regression with sparse priors
• Improving Outfit Recommendation with Co-supervision of Fashion Generation
• The Internet of Federated Things (IoFT): A Vision for the Future and In-depth Survey of Data-driven Approaches for Federated Learning
• QU-BraTS: MICCAI BraTS 2020 Challenge on Quantifying Uncertainty in Brain Tumor Segmentation - Analysis of Ranking Scores and Benchmarking Results
• A taxonomy of surprise definitions
• Deep Neural Generative Model of Functional MRI Images for Psychiatric Disorder Diagnosis
• A Perspective on Deep Learning for Molecular Modeling and Simulations
• Deep-Learning Jets with Uncertainties and More
• Challenges for Unsupervised Anomaly Detection in Particle Physics
• Learning the latent structure of collider events
• Variational inference with a quantum computer
• Community detection in networks without observing edges
• Blind Equalization and Channel Estimation in Coherent Optical Communications Using Variational Autoencoders
• Enhanced Sampling in the Age of Machine Learning: Algorithms and Applications
• Importance nested sampling with normalising flows
• A Factor Graph Approach to Automated Design of Bayesian Signal Processing Algorithms
• The Free Energy Principle for Perception and Action: A Deep Learning Perspective
• Geometric variational inference
• Consistency of Variational Bayes Inference for Estimation and Model Selection in Mixtures
• Bayesian Physics-Informed Neural Networks for the Subsurface Tomography based on the Eikonal Equation
• Exoplanet Validation with Machine Learning: 50 new validated Kepler planets
• Per-Object Systematics using Deep-Learned Calibration
• Predicting the Popularity of Micro-videos with Multimodal Variational Encoder-Decoder Framework
• A Deep Learning Algorithm for High-Dimensional Exploratory Item Factor Analysis
• Learning the Ising Model with Generative Neural Networks
• Bayesian Physics Informed Neural Networks for Data Assimilation and Spatio-Temporal Modelling of Wildfires
• Non-parametric Estimation of Stochastic Differential Equations with Sparse Gaussian Processes
• Conditionally conjugate mean-field variational Bayes for logistic models
• A physics-aware, probabilistic machine learning framework for coarse-graining high-dimensional systems in the Small Data regime
• Probabilistic Count Matrix Factorization for Single Cell Expression Data Analysis
• Bayesian Sequential Optimal Experimental Design for Nonlinear Models Using Policy Gradient Reinforcement Learning
• Deep Gaussian Processes for Biogeophysical Parameter Retrieval and Model Inversion
• Bayesian Estimation of Mixed Multinomial Logit Models: Advances and Simulation-Based Evaluations
• A stochastic version of Stein Variational Gradient Descent for efficient sampling
• Weighted Bayesian Bootstrap for Scalable Bayes
• Block-Term Tensor Decomposition Model Selection and Computation: The Bayesian Way
• Mean-field inference methods for neural networks
• CosmoPower-JAX: high-dimensional Bayesian inference with differentiable cosmological emulators
• Gauge equivariant neural networks for quantum lattice gauge theories
• A novel framework for semi-Bayesian radial velocities through template matching
• Bayesian neural networks via MCMC: a Python-based tutorial
• Variational Bayes survival analysis for unemployment modelling
• GIGA-Lens: Fast Bayesian Inference for Strong Gravitational Lens Modeling
• How higher goals are constructed and collapse under stress: a hierarchical Bayesian control systems perspective
• An introduction to variational inference in Geophysical inverse problems
• Bayesian multiscale deep generative model for the solution of high-dimensional inverse problems
• Quantification of Deep Neural Network Prediction Uncertainties for VVUQ of Machine Learning Models
• Bayesian deep learning with hierarchical prior: Predictions from limited and noisy data
• Advancing Thermodynamic Group-Contribution Methods by Machine Learning: UNIFAC 2.0
• Bayesian model and dimension reduction for uncertainty propagation: applications in random media
• Three-dimensional dust density structure of the Orion, Cygnus X,Taurus, and Perseus star-forming regions
• Gibbs sampler and coordinate ascent variational inference: a set-theoretical review
• Variational Image Feature Extraction for the Event Horizon Telescope
• Semi Conditional Variational Auto-Encoder for Flow Reconstruction and Uncertainty Quantification from Limited Observations
• Forecasting: theory and practice
• A probabilistic generative model for semi-supervised training of coarse-grained surrogates and enforcing physical constraints through virtual observables
• Semi-supervised source localization with deep generative modeling
• Variational Autoencoder Leveraged MMSE Channel Estimation
• Mutually-Regularized Dual Collaborative Variational Auto-encoder for Recommendation Systems
• Deep Learning Assisted Data Inspection for Radio Astronomy
• Adversarial Semantic Scene Completion from a Single Depth Image
• Interpretable machine learning for high-dimensional trajectories of aging health
• Variational Inference as an alternative to MCMC for parameter estimation and model selection
• Variational Bayesian Approximation of Inverse Problems using Sparse Precision Matrices
• Efficient Bayesian Uncertainty Estimation for nnU-Net
• Hierarchical Multinomial-Dirichlet model for the estimation of conditional probability tables
• Variational Inference at Glacier Scale
• Variational Dynamic for Self-Supervised Exploration in Deep Reinforcement Learning
• Bayesian Neural Networks With Maximum Mean Discrepancy Regularization
• Enabling Robust State Estimation through Measurement Error Covariance Adaptation
• Finite sample properties of parametric MMD estimation: robustness to misspecification and dependence
• Bayesian Mechanics for Stationary Processes
• SubStrat: A Subset-Based Strategy for Faster AutoML
• Low-Order Flow Reconstruction and Uncertainty Quantification in Disturbed Aerodynamics Using Sparse Pressure Measurements
• Approximate Bayesian Model Inversion for PDEs with Heterogeneous and State-Dependent Coefficients
• GFlowNets for AI-Driven Scientific Discovery
• Gaussian Variational State Estimation for Nonlinear State-Space Models
• Coupled VAE: Improved Accuracy and Robustness of a Variational Autoencoder
• Latent Network Models to Account for Noisy, Multiply-Reported Social Network Data
• Counterfactual Inference for Consumer Choice Across Many Product Categories
• Neural network model for imprecise regression with interval dependent variables
• Functional PCA and Deep Neural Networks-based Bayesian Inverse Uncertainty Quantification with Transient Experimental Data
• Bi-fidelity Variational Auto-encoder for Uncertainty Quantification
• Modified UNIFAC 2.0 -- A Group-Contribution Method Completed with Machine Learning
• Machine Learning with High-Cardinality Categorical Features in Actuarial Applications
• On gray-box modeling for virtual flow metering
• Evaluating uncertainties in electrochemical impedance spectra of solid oxide fuel cells
• A Bayesian Approach to In-Game Win Probability in Soccer
• Some models are useful, but how do we know which ones? Towards a unified Bayesian model taxonomy
• Stein variational gradient descent with local approximations
• Physics-informed Information Field Theory for Modeling Physical Systems with Uncertainty Quantification
• Probabilistic Neural Data Fusion for Learning from an Arbitrary Number of Multi-fidelity Data Sets
• State-space aerodynamic model reveals high force control authority and predictability in flapping flight
• Approximating Bayes in the 21st Century
• Learning credit assignment
• The three-dimensional structure of Galactic molecular cloud complexes out to 2.5 kpc
• Conditional deep generative models as surrogates for spatial field solution reconstruction with quantified uncertainty in Structural Health Monitoring applications
• Sampling the full hierarchical population posterior distribution in gravitational-wave astronomy
• Fast, Scalable Approximations to Posterior Distributions in Extended Latent Gaussian Models
• Fitting Structural Equation Models via Variational Approximations
• Dynamic fault detection and diagnosis for alkaline water electrolyzer with variational Bayesian Sparse principal component analysis
• Variational Inference with NoFAS: Normalizing Flow with Adaptive Surrogate for Computationally Expensive Models
• A Bayesian Deep Learning Approach to Near-Term Climate Prediction
• Expert Elicitation and Data Noise Learning for Material Flow Analysis using Bayesian Inference
• Modelling stellar activity with Gaussian process regression networks
• Tracing Halpha Fibrils through Bayesian Deep Learning
• Fast Maximum Likelihood estimation via Equilibrium Expectation for Large Network Data
• Causality and Bayesian network PDEs for multiscale representations of porous media
• Artificial Intelligence for Science in Quantum, Atomistic, and Continuum Systems
• Interpretable Subgroup Discovery in Treatment Effect Estimation with Application to Opioid Prescribing Guidelines
• Sparse Bayesian Estimation of Parameters in Linear-Gaussian State-Space Models
• A Stochastic Block Model Approach for the Analysis of Multilevel Networks: an Application to the Sociology of Organizations
• Particle-based Energetic Variational Inference
• Fast and Accurate Estimation of Non-Nested Binomial Hierarchical Models Using Variational Inference
• Real-Time Prediction of Gas Flow Dynamics in Diesel Engines using a Deep Neural Operator Framework
• Bayesian Modelling of Multivalued Power Curves from an Operational Wind Farm
• A Gaussian variational inference approach to motion planning
• Single-Carrier Index Modulation for IoT Uplink
• Variational Prior Replacement in Bayesian Inference and Inversion
• Probabilistic feature extraction, dose statistic prediction and dose mimicking for automated radiation therapy treatment planning
• Variational Bayesian Weighted Complex Network Reconstruction
• Multiband Probabilistic Cataloging: A Joint Fitting Approach to Point Source Detection and Deblending
• Benchmarking common uncertainty estimation methods with histopathological images under domain shift and label noise
• Dynamics of coordinate ascent variational inference: A case study in 2D Ising models
• Online Deep Learning from Doubly-Streaming Data
• Reconstructing the Universe with Variational self-Boosted Sampling
• Hierarchical clustering with discrete latent variable models and the integrated classification likelihood
• BIISQ: Bayesian nonparametric discovery of Isoforms and Individual Specific Quantification
• Graph-based sequential beamforming
• Bayesian inference of three-dimensional gas maps: I. Galactic CO
• Bayesian unsupervised learning reveals hidden structure in concentrated electrolytes
• Ab initio Canonical Sampling based on Variational Inference
• Semiparametric Regression using Variational Approximations
• Inferring stochastic rates from heterogeneous snapshots of particle positions
• CUQIpy: I. Computational uncertainty quantification for inverse problems in Python
• Leveraging Bayesian Analysis To Improve Accuracy of Approximate Models
• Prediction and Uncertainty Quantification of SAFARI-1 Axial Neutron Flux Profiles with Neural Networks
• Detecting the periodicity of highly irregularly sampled light-curves with Gaussian processes: the case of SDSSJ025214.67-002813.7
• Scalable Bayesian Approach for the DINA Q-matrix Estimation Combining Stochastic Optimization and Variational Inference
• A probabilistic deep learning model of inter-fraction anatomical variations in radiotherapy
• Densities of Almost Surely Terminating Probabilistic Programs are Differentiable Almost Everywhere
• Probabilistic surrogate modeling of offshore wind-turbine loads with chained Gaussian processes
• A cross-center smoothness prior for variational Bayesian brain tissue segmentation
• On efficient computation in active inference
• FedVAE: Trajectory privacy preserving based on Federated Variational AutoEncoder
• Cyclical Variational Bayes Monte Carlo for Efficient Multi-Modal Posterior Distributions Evaluation
• Annealed Stein Variational Gradient Descent for Improved Uncertainty Estimation in Full-Waveform Inversion
• Improving Robustness and Uncertainty Modelling in Neural Ordinary Differential Equations
• Streaming Variational Monte Carlo
• Layer Adaptive Node Selection in Bayesian Neural Networks: Statistical Guarantees and Implementation Details
• Expectation Propagation for Poisson Data
• A Quantum Extension of Variational Bayes Inference
• Infinite-dimensional gradient-based descent for alpha-divergence minimisation
• A Learning- and Scenario-based MPC Design for Nonlinear Systems in LPV Framework with Safety and Stability Guarantees
• Fast Scalable Image Restoration using Total Variation Priors and Expectation Propagation
• Rapid inference and comparison of gravitational-wave population models with neural variational posteriors
• Stochastic triangular mesh mapping: A terrain mapping technique for autonomous mobile robots
• Bayesian Model Selection via Mean-Field Variational Approximation
• Physics-Aware Neural Implicit Solvers for multiscale, parametric PDEs with applications in heterogeneous media
• Robust Errant Beam Prognostics with Conditional Modeling for Particle Accelerators
• Path-Specific Counterfactual Fairness for Recommender Systems
• Computing Bayes: From Then 'Til Now'
• Bayesian Learning of Parameterised Quantum Circuits
• Using Bayesian Deep Learning to infer Planet Mass from Gaps in Protoplanetary Disks
• Bayesian Active Learning for Discrete Latent Variable Models
• Online Bayesian changepoint detection for network Poisson processes with community structure
• An approximate expectation-maximization for two-dimensional multi-target detection
• An uncertainty-aware Digital Shadow for underground multimodal CO2 storage monitoring
• Exploring Bayesian Deep Learning for Urgent Instructor Intervention Need in MOOC Forums
• Information-geometry of physics-informed statistical manifolds and its use in data assimilation
• BVAR-Connect: A Variational Bayes Approach to Multi-Subject Vector Autoregressive Models for Inference on Brain Connectivity Networks
• Learning on dynamic statistical manifolds
• Inferring a network from dynamical signals at its nodes
• Reducing Magnetic Resonance Image Spacing by Learning Without Ground-Truth
• Application of the Free Energy Principle to Estimation and Control
• Active and transfer learning with partially Bayesian neural networks for materials and chemicals
• Neutron Transmission Strain Tomography for Non-Constant Stress-Free Lattice Spacing
• Stratified stochastic variational inference for high-dimensional network factor model
• Deep Generative Modeling-based Data Augmentation with Demonstration using the BFBT Benchmark Void Fraction Datasets
• Machine Learning the 6th Dimension: Stellar Radial Velocities from 5D Phase-Space Correlations
• Cross-modal Variational Auto-encoder for Content-based Micro-video Background Music Recommendation
• Channel-driven Decentralized Bayesian Federated Learning for Trustworthy Decision Making in D2D Networks
• Superregular grammars do not provide additional explanatory power but allow for a compact analysis of animal song
• Correntropy-Based Logistic Regression with Automatic Relevance Determination for Robust Sparse Brain Activity Decoding
• The missing radial velocities of Gaia: blind predictions for DR3
• Beyond expected values: Making environmental decisions using value of information analysis when measurement outcome matters
• Variational Bayes image restoration with compressive autoencoders
• Variational Bayes for high-dimensional proportional hazards models with applications within gene expression
• Geometric Methods for Sampling, Optimisation, Inference and Adaptive Agents
• Deep learning-driven likelihood-free parameter inference for 21-cm forest observations
• Integrating time-resolved $nrf2$ gene-expression data into a full GUTS model as a proxy for toxicodynamic damage in zebrafish embryo
• Accurate Surrogate Amplitudes with Calibrated Uncertainties
• Dual Accuracy-Quality-Driven Neural Network for Prediction Interval Generation
• Stochastic Modeling of Inhomogeneities in the Aortic Wall and Uncertainty Quantification using a Bayesian Encoder-Decoder Surrogate
• Fast Variational Inference for Bayesian Factor Analysis in Single and Multi-Study Settings
• Bayesian Adaptive Selection of Basis Functions for Functional Data Representation
• Shift-BNN: Highly-Efficient Probabilistic Bayesian Neural Network Training via Memory-Friendly Pattern Retrieving
• Automatic differentiation is no panacea for phylogenetic gradient computation
• Variational Autoencoders for Anomaly Detection in Respiratory Sounds
• How Bayesian Should Bayesian Optimisation Be?
• Graph link prediction in computer networks using Poisson matrix factorisation
• Multivariate Bayesian structured variable selection for pharmacogenomic studies
• Two new calibration techniques of lumped-parameter mathematical models for the cardiovascular system
• Truly Multivariate Structured Additive Distributional Regression
• A Probabilistic Model for Aircraft in Climb using Monotonic Functional Gaussian Process Emulators
• VIP -- Variational Inversion Package with example implementations of Bayesian tomographic imaging
• An Investigation on Machine Learning Predictive Accuracy Improvement and Uncertainty Reduction using VAE-based Data Augmentation
• Generative Model with Coordinate Metric Learning for Object Recognition Based on 3D Models
• Probabilistic Programming with Programmable Variational Inference
• Minimum regularized covariance trace estimator and outlier detection for functional data
• Generalization capabilities and robustness of hybrid models grounded in physics compared to purely deep learning models
• Adaptive group-regularized logistic elastic net regression
• Bayesian Model Selection for Network Discrimination and Risk-informed Decision Making in Material Flow Analysis
• Learning to solve Bayesian inverse problems: An amortized variational inference approach using Gaussian and Flow guides
• Variational Estimation for Multidimensional Generalized Partial Credit Model
• The Posterior Predictive Null
• Variational inference based on a subclass of closed skew normals
• Gaussian Mixture Reduction with Composite Transportation Divergence
• Stein Variational Gradient Descent with Multiple Kernel
• Calibration procedures for approximate Bayesian credible sets
• Partially factorized variational inference for high-dimensional mixed models
• Bayesian calibration of coupled computational mechanics models under uncertainty based on interface deformation
• Latent Dirichlet Analysis of Categorical Survey Responses
• Sparse online variational Bayesian regression
• Streamlining Variational Inference for Constraint Satisfaction Problems
• Inferring the Langevin Equation with Uncertainty via Bayesian Neural Networks
• Simulation-Based Inference of Surface Accumulation and Basal Melt Rates of an Antarctic Ice Shelf from Isochronal Layers
• The interplay between ranking and communities in networks
• Improvement and generalization of ABCD method with Bayesian inference
• All you need is spin: SU(2) equivariant variational quantum circuits based on spin networks
• vEEGNet: learning latent representations to reconstruct EEG raw data via variational autoencoders
• A Note on Improving Variational Estimation for Multidimensional Item Response Theory
• Bayesian sparsification for deep neural networks with Bayesian model reduction
• A Bayesian Gaussian Process-Based Latent Discriminative Generative Decoder (LDGD) Model for High-Dimensional Data
• Single- to multi-fidelity history-dependent learning with uncertainty quantification and disentanglement: application to data-driven constitutive modeling
• Variational Autoencoder Kernel Interpretation and Selection for Classification
• Variational mean-field theory for training restricted Boltzmann machines with binary synapses
• Bayesian decomposition of the Galactic multi-frequency sky using probabilistic autoencoders
• Weakly-supervised Multi-output Regression via Correlated Gaussian Processes
• The missing radial velocities of Gaia: a catalogue of Bayesian estimates for DR3
• Variational Inference and Sparsity in High-Dimensional Deep Gaussian Mixture Models
• Principled Pruning of Bayesian Neural Networks through Variational Free Energy Minimization
• Non-centered parametric variational Bayes' approach for hierarchical inverse problems of partial differential equations
• Indoor thermal comfort management: A Bayesian machine-learning approach to data denoising and dynamics prediction of HVAC systems
• Semi-supervised empirical Bayes group-regularized factor regression
• An Information Theory Approach on Deciding Spectroscopic Follow Ups
• First look at Vela X-1 with XRISM: A simultaneous campaign with XMM-Newton and NuSTAR
• Molecular Dynamics and Machine Learning Unlock Possibilities in Beauty Design -- A Perspective
• Variational Bayesian surrogate modelling with application to robust design optimisation
• Nearly Consistent Finite Particle Estimates in Streaming Importance Sampling
• Generative AI for Brane Configurations and Coamoeba
• Return to Lacan: an approach to digital twin mind with free energy principle
• Reconstructing Sparse Multiplex Networks with Application to Covert Networks
• Unsupervised detection of coordinated information operations in the wild
• Informative Bayesian model selection for RR Lyrae star classifiers
• jaxspec : a fast and robust Python library for X-ray spectral fitting
• PAC-Bayes Bounds for Bandit Problems: A Survey and Experimental Comparison
• CSI Clustering with Variational Autoencoding
• Conformal Quantile Regression for Neural Probabilistic Constitutive Modeling
• Monte Carlo inference for semiparametric Bayesian regression
• Gaussbock: Fast parallel-iterative cosmological parameter estimation with Bayesian nonparametrics
• Manifold Sampling for Differentiable Uncertainty in Radiance Fields
• VARADE: a Variational-based AutoRegressive model for Anomaly Detection on the Edge
• Revisiting Group Differences in High-Dimensional Choices: Method and Application to Congressional Speech
• Bayesian RG Flow in Neural Network Field Theories
• Bayesian Neural Networks for Virtual Flow Metering: An Empirical Study
• Federated Bayesian Deep Learning: The Application of Statistical Aggregation Methods to Bayesian Models
• Uncertainty Quantification of Graph Convolution Neural Network Models of Evolving Processes
• Enhancing Dynamical System Modeling through Interpretable Machine Learning Augmentations: A Case Study in Cathodic Electrophoretic Deposition
• Nonparametric Bayesian volatility estimation
• Towards Bayesian Data Compression
• Inferring the density and membership of stellar streams with flexible models: The GD-1 stream in Gaia Data Release 3
• Unifying supervised learning and VAEs -- coverage, systematics and goodness-of-fit in normalizing-flow based neural network models for astro-particle reconstructions
• Large-Scale Joint Topic, Sentiment & User Preference Analysis for Online Reviews
• A Two-Stage Bayesian Semiparametric Model for Novelty Detection with Robust Prior Information
• The sociospatial factors of death: Analyzing effects of geospatially-distributed variables in a Bayesian mortality model for Hong Kong
• Bayesian Reasoning with Trained Neural Networks
• Ordinal Outcome State-Space Models for Intensive Longitudinal Data
• Multi-Physics-Enhanced Bayesian Inverse Analysis: Information Gain from Additional Fields
• TABASCAL: Removing multi-satellite interference from radio interferometry observations
• Leveraging Active Subspaces to Capture Epistemic Model Uncertainty in Deep Generative Models for Molecular Design
• Uncertainties of Satellite-based Essential Climate Variables from Deep Learning
• Gaussian Mixture Reduction for Time-Constrained Approximate Inference in Hybrid Bayesian Networks
• Generalized Decomposition Priors on R2
• Deep mixture of linear mixed models for complex longitudinal data
• A Bayesian Fisher-EM algorithm for discriminative Gaussian subspace clustering
• Variational Inference for Quantum HyperNetworks
• Deep learning and differential equations for modeling changes in individual-level latent dynamics between observation periods
• Composite likelihood inference for the Poisson log-normal model
• Causality-aware Graph Aggregation Weight Estimator for Popularity Debiasing in Top-K Recommendation
• Bayesian Joint Chance Constrained Optimization: Approximations and Statistical Consistency
• Hierarchical mixtures of Unigram models for short text clustering: The role of Beta-Liouville priors
• Leveraging Normalizing Flows for Orbital-Free Density Functional Theory
• Interrogating probabilistic inversion results for subsurface structural information
• Self-supervised Latent Space Optimization with Nebula Variational Coding
• A Concise Mathematical Description of Active Inference in Discrete Time
• A Statistical Model of Bipartite Networks: Application to Cosponsorship in the United States Senate
• Temporal Latent Variable Structural Causal Model for Causal Discovery under External Interferences
• Bayesian Experimental Design for Model Discrepancy Calibration: A Rivalry between Kullback--Leibler Divergence and Wasserstein Distance
• Policy Gradient Approach to Compilation of Variational Quantum Circuits
• Greedy clustering of count data through a mixture of multinomial PCA
• Seeded Poisson Factorization: leveraging domain knowledge to fit topic models
• Variational Inference for the Latent Shrinkage Position Model
• Computationally efficient variational-like approximations of possibilistic inferential models
• Maximum Probability Theorem: A Framework for Probabilistic Learning
• Bayesian Experimental Design for Model Discrepancy Calibration: An Auto-Differentiable Ensemble Kalman Inversion Approach
• Active Inference Meeting Energy-Efficient Control of Parallel and Identical Machines
• Doubly Adaptive Importance Sampling
• Modelling variability in vibration-based PBSHM via a generalised population form
• Unsupervised Bayesian classification for models with scalar and functional covariates
• ProBoost: a Boosting Method for Probabilistic Classifiers
• Probabilistic partition of unity networks for high-dimensional regression problems
• Symmetry-driven embedding of networks in hyperbolic space
• Learn Quasi-stationary Distributions of Finite State Markov Chain
• Alpha-VI DeepONet: A prior-robust variational Bayesian approach for enhancing DeepONets with uncertainty quantification
• On the Impact of Sampling on Deep Sequential State Estimation
• Tightening the Biological Constraints on Gradient-Based Predictive Coding
• A Bayesian Nonparametric Stochastic Block Model for Directed Acyclic Graphs
• Properties and Bayesian fitting of restricted Boltzmann machines
• Uncertainty quantification for White Matter Hyperintensity segmentation detects silent failures and improves automated Fazekas quantification
• PAC-Bayes Bounds on Variational Tempered Posteriors for Markov Models
• Simultaneous inference of periods and period-luminosity relations for Mira variable stars
• The Bayesian Method of Tensor Networks
• MFAI: A Scalable Bayesian Matrix Factorization Approach to Leveraging Auxiliary Information
• On the Consistency of a Random Forest Algorithm in the Presence of Missing Entries
• Quantifying imperfect cognition via achieved information gain
• Regularized Bayesian calibration and scoring of the WD-FAB IRT model improves predictive performance over marginal maximum likelihood
• Variational Bayes latent class approach for EHR-based phenotyping with large real-world data
• The Price equation reveals a universal force-metric-bias law of algorithmic learning and natural selection
• Bayesian Models Applied to Cyber Security Anomaly Detection Problems
• Tuning Random Generators: Property-Based Testing as Probabilistic Programming
• Testing Homogeneity for Normal Mixture Models: Variational Bayes Approach
• Bayesian neural networks with interpretable priors from Mercer kernels
• The Renyi Gaussian Process: Towards Improved Generalization
• R-VGAL: A Sequential Variational Bayes Algorithm for Generalised Linear Mixed Models
• Towards Generative Location Awareness for Disaster Response: A Probabilistic Cross-view Geolocalization Approach
• Noncooperative dynamics in election interference
• Posterior Collapse as a Phase Transition in Variational Autoencoders
• Evaluating Negative Sampling Approaches for Neural Topic Models
• Gradient-Free Score-Based Sampling Methods with Ensembles
• Programming with Neural Surrogates of Programs
• Automated Movement Detection with Dirichlet Process Mixture Models and Electromyography
• Advances in Neural 3D Mesh Texturing: A Survey
• Prediction of Diffusion Coefficients in Mixtures with Tensor Completion
• Random Spiking and Systematic Evaluation of Defenses Against Adversarial Examples
• A Framework for the Bayesian Calibration of Complex and Data-Scarce Models in Applied Sciences
• EvoVGM: a Deep Variational Generative Model for Evolutionary Parameter Estimation
• Group Spike and Slab Variational Bayes
• Efficacy Analysis in Clinical Trials: A Comprehensive Review of Statistical and Machine Learning Approaches
• Probabilistic Registration for Gaussian Process 3D shape modelling in the presence of extensive missing data
• A Bayesian approach to aggregated chemical exposure assessment
• Generative multi-scale modeling via spatial autoregressive transport maps
• Scalable Variational Inference for Multinomial Probit Models under Large Choice Sets and Sample Sizes
• Auto-encoding GPS data to reveal individual and collective behaviour
• Adversarial Disentanglement by Backpropagation with Physics-Informed Variational Autoencoder
• Probabilistic Zeeman-Doppler imaging of stellar magnetic fields: I. Analysis of tau Scorpii in the weak-field limit
• Variational inference for hierarchical models with conditional scale and skewness corrections
• An Application to Generate Style Guided Compatible Outfit
• CALF-SBM: A Covariate-Assisted Latent Factor Stochastic Block Model
• Fast Sampling of Cosmological Initial Conditions with Gaussian Neural Posterior Estimation
• Efficient Iterative Proximal Variational Inference Motion Planning
• Probabilistic Latent Factor Model for Collaborative Filtering with Bayesian Inference
• Improving the convergence of Markov chains via permutations and projections
• Rapid Risk Minimization with Bayesian Models Through Deep Learning Approximation
• Evolving Voices Based on Temporal Poisson Factorisation
• Non-conjugate variational Bayes for pseudo-likelihood mixed effect models
• Importance sampling-based gradient method for dimension reduction in Poisson log-normal model
• MLMOD: Machine Learning Methods for Data-Driven Modeling in LAMMPS
• Data-driven modeling of time-domain induced polarization
• Navigating Uncertainties in Machine Learning for Structural Dynamics: A Comprehensive Survey of Probabilistic and Non-Probabilistic Approaches in Forward and Inverse Problems
• Tightening Bounds for Variational Inference by Revisiting Perturbation Theory
• A PAC-Bayes oracle inequality for sparse neural networks
• Statistical Inferences and Predictions for Areal Data and Spatial Data Fusion with Hausdorff--Gaussian Processes
• Covariate-Elaborated Robust Partial Information Transfer with Conditional Spike-and-Slab Prior
• Law of Large Numbers for Bayesian two-layer Neural Network trained with Variational Inference