Variational Inference: A Review for Statisticians
arXiv:1601.00670 · doi:10.1080/01621459.2017.1285773
Abstract
One of the core problems of modern statistics is to approximate difficult-to-compute probability densities. This problem is especially important in Bayesian statistics, which frames all inference about unknown quantities as a calculation involving the posterior density. In this paper, we review variational inference (VI), a method from machine learning that approximates probability densities through optimization. VI has been used in many applications and tends to be faster than classical methods, such as Markov chain Monte Carlo sampling. The idea behind VI is to first posit a family of densities and then to find the member of that family which is close to the target. Closeness is measured by Kullback-Leibler divergence. We review the ideas behind mean-field variational inference, discuss the special case of VI applied to exponential family models, present a full example with a Bayesian mixture of Gaussians, and derive a variant that uses stochastic optimization to scale up to massive data. We discuss modern research in VI and highlight important open problems. VI is powerful, but it is not yet well understood. Our hope in writing this paper is to catalyze statistical research on this class of algorithms.
References in corpus (22)
- Stochastic Backpropagation and Approximate Inference in Deep Generative Models
- The No-U-Turn Sampler: Adaptively Setting Path Lengths in Hamiltonian Monte Carlo
- Expectation Propagation for approximate Bayesian inference
- A correlated topic model of Science
- Markov Chain Monte Carlo and Variational Inference: Bridging the Gap
- A Bayesian Approach to Network Modularity
- Asymptotic normality of maximum likelihood and its variational approximation for stochastic blockmodels
- Automatic Differentiation Variational Inference
- Variational inference for large-scale models of discrete choice
- Describing disability through individual-level mixture models for multivariate binary data
- Variational Bayesian Inference with Stochastic Search
- Fast Variational Inference in the Conjugate Exponential Family
- Automated Variational Inference in Probabilistic Programming
- Variational Gaussian Process Dynamical Systems
- Computing Upper and Lower Bounds on Likelihoods in Intractable Networks
- Gaussian variational approximation with sparse precision matrices
- Asymptotic normality and valid inference for Gaussian variational approximation
- Stochastic Variational Inference for Hidden Markov Models
- Variational Inference for Generalized Linear Mixed Models Using Partially Noncentered Parametrizations
- Linear Response Methods for Accurate Covariance Estimates from Mean Field Variational Bayes
- Celeste: Variational inference for a generative model of astronomical images
- Variational Cumulant Expansions for Intractable Distributions
Cited by in corpus (410)
- A Review of Uncertainty Quantification in Deep Learning: Techniques, Applications and Challenges
- dynesty: A Dynamic Nested Sampling Package for Estimating Bayesian Posteriors and Evidences
- Hands-on Bayesian Neural Networks -- a Tutorial for Deep Learning Users
- Informed Machine Learning -- A Taxonomy and Survey of Integrating Knowledge into Learning Systems
- Bayesian Deep Convolutional Encoder-Decoder Networks for Surrogate Modeling and Uncertainty Quantification
- KalmanNet: Neural Network Aided Kalman Filtering for Partially Known Dynamics
- Using stacking to average Bayesian predictive distributions
- Uncertainty Quantification in Scientific Machine Learning: Methods, Metrics, and Comparisons
- Adversarial Uncertainty Quantification in Physics-Informed Neural Networks
- Uncertainty Quantification in Machine Learning for Engineering Design and Health Prognostics: A Tutorial
- Active inference on discrete state-spaces: a synthesis
- Bayesian Neural Networks: An Introduction and Survey
- Frequentist Consistency of Variational Bayes
- Graph Neural Networks: Taxonomy, Advances and Trends
- Physics-Informed Probabilistic Learning of Linear Embeddings of Non-linear Dynamics With Guaranteed Stability
- Active inference: demystified and compared
- MoRe-Fi: Motion-robust and Fine-grained Respiration Monitoring via Deep-Learning UWB Radar
- An Ensemble of Epoch-wise Empirical Bayes for Few-shot Learning
- On Bayesian Mechanics: A Physics of and by Beliefs
- A Survey on Neural Topic Models: Methods, Applications, and Challenges
- Sampling using gauge equivariant flows
- Machine Learning in Thermodynamics: Prediction of Activity Coefficients by Matrix Completion
- Inf-VAE: A Variational Autoencoder Framework to Integrate Homophily and Influence in Diffusion Prediction
- Bayesian Parameter Estimation for Dynamical Models in Systems Biology
- Calibrating general posterior credible regions
- A Unified Statistical Framework for Single Cell and Bulk RNA Sequencing Data
- Modeling emotion in complex stories: the Stanford Emotional Narratives Dataset
- Seismic tomography using variational inference methods
- Audio-visual Speech Enhancement Using Conditional Variational Auto-Encoders
- Understanding Event-Generation Networks via Uncertainties
- Generative Networks for Precision Enthusiasts
- Measuring and modeling the motor system with machine learning
- An Ensemble of Bayesian Neural Networks for Exoplanetary Atmospheric Retrieval
- Valid prediction intervals for regression problems
- Bayesian delensing delight: sampling-based inference of the primordial CMB and gravitational lensing
- Variational Bayes for high-dimensional linear regression with sparse priors
- Improving Outfit Recommendation with Co-supervision of Fashion Generation
- The Internet of Federated Things (IoFT): A Vision for the Future and In-depth Survey of Data-driven Approaches for Federated Learning
- QU-BraTS: MICCAI BraTS 2020 Challenge on Quantifying Uncertainty in Brain Tumor Segmentation - Analysis of Ranking Scores and Benchmarking Results
- A taxonomy of surprise definitions
- A Perspective on Deep Learning for Molecular Modeling and Simulations
- Deep Neural Generative Model of Functional MRI Images for Psychiatric Disorder Diagnosis
- Deep-Learning Jets with Uncertainties and More
- Learning the latent structure of collider events
- Challenges for Unsupervised Anomaly Detection in Particle Physics
- Variational inference with a quantum computer
- Community detection in networks without observing edges
- Blind Equalization and Channel Estimation in Coherent Optical Communications Using Variational Autoencoders
- Importance nested sampling with normalising flows
- Enhanced Sampling in the Age of Machine Learning: Algorithms and Applications
- A Factor Graph Approach to Automated Design of Bayesian Signal Processing Algorithms
- The Free Energy Principle for Perception and Action: A Deep Learning Perspective
- Geometric variational inference
- Consistency of Variational Bayes Inference for Estimation and Model Selection in Mixtures
- Bayesian Physics-Informed Neural Networks for the Subsurface Tomography based on the Eikonal Equation
- Per-Object Systematics using Deep-Learned Calibration
- Exoplanet Validation with Machine Learning: 50 new validated Kepler planets
- Predicting the Popularity of Micro-videos with Multimodal Variational Encoder-Decoder Framework
- Learning the Ising Model with Generative Neural Networks
- A Deep Learning Algorithm for High-Dimensional Exploratory Item Factor Analysis
- Bayesian Physics Informed Neural Networks for Data Assimilation and Spatio-Temporal Modelling of Wildfires
- Non-parametric Estimation of Stochastic Differential Equations with Sparse Gaussian Processes
- A physics-aware, probabilistic machine learning framework for coarse-graining high-dimensional systems in the Small Data regime
- Probabilistic Count Matrix Factorization for Single Cell Expression Data Analysis
- Conditionally conjugate mean-field variational Bayes for logistic models
- Bayesian Sequential Optimal Experimental Design for Nonlinear Models Using Policy Gradient Reinforcement Learning
- Deep Gaussian Processes for Biogeophysical Parameter Retrieval and Model Inversion
- A stochastic version of Stein Variational Gradient Descent for efficient sampling
- Bayesian Estimation of Mixed Multinomial Logit Models: Advances and Simulation-Based Evaluations
- Mean-field inference methods for neural networks
- Block-Term Tensor Decomposition Model Selection and Computation: The Bayesian Way
- Weighted Bayesian Bootstrap for Scalable Bayes
- CosmoPower-JAX: high-dimensional Bayesian inference with differentiable cosmological emulators
- Bayesian neural networks via MCMC: a Python-based tutorial
- A novel framework for semi-Bayesian radial velocities through template matching
- Gauge equivariant neural networks for quantum lattice gauge theories
- Variational Bayes survival analysis for unemployment modelling
- GIGA-Lens: Fast Bayesian Inference for Strong Gravitational Lens Modeling
- How higher goals are constructed and collapse under stress: a hierarchical Bayesian control systems perspective
- An introduction to variational inference in Geophysical inverse problems
- Bayesian deep learning with hierarchical prior: Predictions from limited and noisy data
- Bayesian multiscale deep generative model for the solution of high-dimensional inverse problems
- Quantification of Deep Neural Network Prediction Uncertainties for VVUQ of Machine Learning Models
- Bayesian model and dimension reduction for uncertainty propagation: applications in random media
- Advancing Thermodynamic Group-Contribution Methods by Machine Learning: UNIFAC 2.0
- Three-dimensional dust density structure of the Orion, Cygnus X,Taurus, and Perseus star-forming regions
- Gibbs sampler and coordinate ascent variational inference: a set-theoretical review
- Semi Conditional Variational Auto-Encoder for Flow Reconstruction and Uncertainty Quantification from Limited Observations
- Variational Image Feature Extraction for the Event Horizon Telescope
- Variational Autoencoder Leveraged MMSE Channel Estimation
- A probabilistic generative model for semi-supervised training of coarse-grained surrogates and enforcing physical constraints through virtual observables
- Forecasting: theory and practice
- Semi-supervised source localization with deep generative modeling
- Mutually-Regularized Dual Collaborative Variational Auto-encoder for Recommendation Systems
- Adversarial Semantic Scene Completion from a Single Depth Image
- Deep Learning Assisted Data Inspection for Radio Astronomy
- Interpretable machine learning for high-dimensional trajectories of aging health
- Variational Bayesian Approximation of Inverse Problems using Sparse Precision Matrices
- Efficient Bayesian Uncertainty Estimation for nnU-Net
- Variational Inference as an alternative to MCMC for parameter estimation and model selection
- Variational Inference at Glacier Scale
- Hierarchical Multinomial-Dirichlet model for the estimation of conditional probability tables
- Variational Dynamic for Self-Supervised Exploration in Deep Reinforcement Learning
- Finite sample properties of parametric MMD estimation: robustness to misspecification and dependence
- Enabling Robust State Estimation through Measurement Error Covariance Adaptation
- Bayesian Neural Networks With Maximum Mean Discrepancy Regularization
- Bayesian Mechanics for Stationary Processes
- Low-Order Flow Reconstruction and Uncertainty Quantification in Disturbed Aerodynamics Using Sparse Pressure Measurements
- SubStrat: A Subset-Based Strategy for Faster AutoML
- Approximate Bayesian Model Inversion for PDEs with Heterogeneous and State-Dependent Coefficients
- Counterfactual Inference for Consumer Choice Across Many Product Categories
- Gaussian Variational State Estimation for Nonlinear State-Space Models
- Latent Network Models to Account for Noisy, Multiply-Reported Social Network Data
- Functional PCA and Deep Neural Networks-based Bayesian Inverse Uncertainty Quantification with Transient Experimental Data
- GFlowNets for AI-Driven Scientific Discovery
- Coupled VAE: Improved Accuracy and Robustness of a Variational Autoencoder
- Neural network model for imprecise regression with interval dependent variables
- Modified UNIFAC 2.0 -- A Group-Contribution Method Completed with Machine Learning
- Machine Learning with High-Cardinality Categorical Features in Actuarial Applications
- On gray-box modeling for virtual flow metering
- Bi-fidelity Variational Auto-encoder for Uncertainty Quantification
- The three-dimensional structure of Galactic molecular cloud complexes out to 2.5 kpc
- State-space aerodynamic model reveals high force control authority and predictability in flapping flight
- Physics-informed Information Field Theory for Modeling Physical Systems with Uncertainty Quantification
- A Bayesian Approach to In-Game Win Probability in Soccer
- Stein variational gradient descent with local approximations
- Approximating Bayes in the 21st Century
- Probabilistic Neural Data Fusion for Learning from an Arbitrary Number of Multi-fidelity Data Sets
- Evaluating uncertainties in electrochemical impedance spectra of solid oxide fuel cells
- Some models are useful, but how do we know which ones? Towards a unified Bayesian model taxonomy
- Learning credit assignment
- Fitting Structural Equation Models via Variational Approximations
- Variational Inference with NoFAS: Normalizing Flow with Adaptive Surrogate for Computationally Expensive Models
- Sampling the full hierarchical population posterior distribution in gravitational-wave astronomy
- Conditional deep generative models as surrogates for spatial field solution reconstruction with quantified uncertainty in Structural Health Monitoring applications
- Fast, Scalable Approximations to Posterior Distributions in Extended Latent Gaussian Models
- A Bayesian Deep Learning Approach to Near-Term Climate Prediction
- Dynamic fault detection and diagnosis for alkaline water electrolyzer with variational Bayesian Sparse principal component analysis
- Tracing Halpha Fibrils through Bayesian Deep Learning
- A Gaussian variational inference approach to motion planning
- Fast and Accurate Estimation of Non-Nested Binomial Hierarchical Models Using Variational Inference
- Causality and Bayesian network PDEs for multiscale representations of porous media
- Bayesian Modelling of Multivalued Power Curves from an Operational Wind Farm
- Modelling stellar activity with Gaussian process regression networks
- Artificial Intelligence for Science in Quantum, Atomistic, and Continuum Systems
- Interpretable Subgroup Discovery in Treatment Effect Estimation with Application to Opioid Prescribing Guidelines
- Sparse Bayesian Estimation of Parameters in Linear-Gaussian State-Space Models
- A Stochastic Block Model Approach for the Analysis of Multilevel Networks: an Application to the Sociology of Organizations
- Real-Time Prediction of Gas Flow Dynamics in Diesel Engines using a Deep Neural Operator Framework
- Particle-based Energetic Variational Inference
- Expert Elicitation and Data Noise Learning for Material Flow Analysis using Bayesian Inference
- Fast Maximum Likelihood estimation via Equilibrium Expectation for Large Network Data
- Hierarchical clustering with discrete latent variable models and the integrated classification likelihood
- Variational Prior Replacement in Bayesian Inference and Inversion
- Variational Bayesian Weighted Complex Network Reconstruction
- Reconstructing the Universe with Variational self-Boosted Sampling
- Online Deep Learning from Doubly-Streaming Data
- Dynamics of coordinate ascent variational inference: A case study in 2D Ising models
- Benchmarking common uncertainty estimation methods with histopathological images under domain shift and label noise
- Single-Carrier Index Modulation for IoT Uplink
- Multiband Probabilistic Cataloging: A Joint Fitting Approach to Point Source Detection and Deblending
- Probabilistic feature extraction, dose statistic prediction and dose mimicking for automated radiation therapy treatment planning
- BIISQ: Bayesian nonparametric discovery of Isoforms and Individual Specific Quantification
- Bayesian inference of three-dimensional gas maps: I. Galactic CO
- Bayesian unsupervised learning reveals hidden structure in concentrated electrolytes
- Ab initio Canonical Sampling based on Variational Inference
- Semiparametric Regression using Variational Approximations
- Graph-based sequential beamforming
- Inferring stochastic rates from heterogeneous snapshots of particle positions
- Leveraging Bayesian Analysis To Improve Accuracy of Approximate Models
- CUQIpy: I. Computational uncertainty quantification for inverse problems in Python
- Detecting the periodicity of highly irregularly sampled light-curves with Gaussian processes: the case of SDSSJ025214.67-002813.7
- A probabilistic deep learning model of inter-fraction anatomical variations in radiotherapy
- Prediction and Uncertainty Quantification of SAFARI-1 Axial Neutron Flux Profiles with Neural Networks
- Scalable Bayesian Approach for the DINA Q-matrix Estimation Combining Stochastic Optimization and Variational Inference
- On efficient computation in active inference
- Layer Adaptive Node Selection in Bayesian Neural Networks: Statistical Guarantees and Implementation Details
- Improving Robustness and Uncertainty Modelling in Neural Ordinary Differential Equations
- Expectation Propagation for Poisson Data
- A cross-center smoothness prior for variational Bayesian brain tissue segmentation
- FedVAE: Trajectory privacy preserving based on Federated Variational AutoEncoder
- Streaming Variational Monte Carlo
- Densities of Almost Surely Terminating Probabilistic Programs are Differentiable Almost Everywhere
- Probabilistic surrogate modeling of offshore wind-turbine loads with chained Gaussian processes
- Cyclical Variational Bayes Monte Carlo for Efficient Multi-Modal Posterior Distributions Evaluation
- Annealed Stein Variational Gradient Descent for Improved Uncertainty Estimation in Full-Waveform Inversion
- Physics-Aware Neural Implicit Solvers for multiscale, parametric PDEs with applications in heterogeneous media
- Rapid inference and comparison of gravitational-wave population models with neural variational posteriors
- A Quantum Extension of Variational Bayes Inference
- A Learning- and Scenario-based MPC Design for Nonlinear Systems in LPV Framework with Safety and Stability Guarantees
- Fast Scalable Image Restoration using Total Variation Priors and Expectation Propagation
- Infinite-dimensional gradient-based descent for alpha-divergence minimisation
- Stochastic triangular mesh mapping: A terrain mapping technique for autonomous mobile robots
- Bayesian Model Selection via Mean-Field Variational Approximation
- Reducing Magnetic Resonance Image Spacing by Learning Without Ground-Truth
- Bayesian Learning of Parameterised Quantum Circuits
- BVAR-Connect: A Variational Bayes Approach to Multi-Subject Vector Autoregressive Models for Inference on Brain Connectivity Networks
- Learning on dynamic statistical manifolds
- Application of the Free Energy Principle to Estimation and Control
- Bayesian Active Learning for Discrete Latent Variable Models
- An uncertainty-aware Digital Shadow for underground multimodal CO2 storage monitoring
- Path-Specific Counterfactual Fairness for Recommender Systems
- An approximate expectation-maximization for two-dimensional multi-target detection
- Online Bayesian changepoint detection for network Poisson processes with community structure
- Robust Errant Beam Prognostics with Conditional Modeling for Particle Accelerators
- Information-geometry of physics-informed statistical manifolds and its use in data assimilation
- Computing Bayes: From Then 'Til Now'
- Exploring Bayesian Deep Learning for Urgent Instructor Intervention Need in MOOC Forums
- Using Bayesian Deep Learning to infer Planet Mass from Gaps in Protoplanetary Disks
- Inferring a network from dynamical signals at its nodes
- Channel-driven Decentralized Bayesian Federated Learning for Trustworthy Decision Making in D2D Networks
- Stratified stochastic variational inference for high-dimensional network factor model
- Correntropy-Based Logistic Regression with Automatic Relevance Determination for Robust Sparse Brain Activity Decoding
- Neutron Transmission Strain Tomography for Non-Constant Stress-Free Lattice Spacing
- Machine Learning the 6th Dimension: Stellar Radial Velocities from 5D Phase-Space Correlations
- Deep Generative Modeling-based Data Augmentation with Demonstration using the BFBT Benchmark Void Fraction Datasets
- Superregular grammars do not provide additional explanatory power but allow for a compact analysis of animal song
- Cross-modal Variational Auto-encoder for Content-based Micro-video Background Music Recommendation
- Active and transfer learning with partially Bayesian neural networks for materials and chemicals
- Stochastic Modeling of Inhomogeneities in the Aortic Wall and Uncertainty Quantification using a Bayesian Encoder-Decoder Surrogate
- Beyond expected values: Making environmental decisions using value of information analysis when measurement outcome matters
- Bayesian Adaptive Selection of Basis Functions for Functional Data Representation
- The missing radial velocities of Gaia: blind predictions for DR3
- Accurate Surrogate Amplitudes with Calibrated Uncertainties
- Variational Bayes for high-dimensional proportional hazards models with applications within gene expression
- Dual Accuracy-Quality-Driven Neural Network for Prediction Interval Generation
- Deep learning-driven likelihood-free parameter inference for 21-cm forest observations
- Integrating time-resolved gene-expression data into a full GUTS model as a proxy for toxicodynamic damage in zebrafish embryo
- Fast Variational Inference for Bayesian Factor Analysis in Single and Multi-Study Settings
- Geometric Methods for Sampling, Optimisation, Inference and Adaptive Agents
- Variational Bayes image restoration with compressive autoencoders
- Truly Multivariate Structured Additive Distributional Regression
- VIP -- Variational Inversion Package with example implementations of Bayesian tomographic imaging
- Minimum regularized covariance trace estimator and outlier detection for functional data
- Generalization capabilities and robustness of hybrid models grounded in physics compared to purely deep learning models
- Automatic differentiation is no panacea for phylogenetic gradient computation
- A Probabilistic Model for Aircraft in Climb using Monotonic Functional Gaussian Process Emulators
- Variational Autoencoders for Anomaly Detection in Respiratory Sounds
- Two new calibration techniques of lumped-parameter mathematical models for the cardiovascular system
- An Investigation on Machine Learning Predictive Accuracy Improvement and Uncertainty Reduction using VAE-based Data Augmentation
- How Bayesian Should Bayesian Optimisation Be?
- Multivariate Bayesian structured variable selection for pharmacogenomic studies
- Graph link prediction in computer networks using Poisson matrix factorisation
- Probabilistic Programming with Programmable Variational Inference
- Shift-BNN: Highly-Efficient Probabilistic Bayesian Neural Network Training via Memory-Friendly Pattern Retrieving
- Generative Model with Coordinate Metric Learning for Object Recognition Based on 3D Models
- Variational inference based on a subclass of closed skew normals
- Sparse online variational Bayesian regression
- Variational Estimation for Multidimensional Generalized Partial Credit Model
- Adaptive group-regularized logistic elastic net regression
- Bayesian calibration of coupled computational mechanics models under uncertainty based on interface deformation
- The Posterior Predictive Null
- Latent Dirichlet Analysis of Categorical Survey Responses
- Learning to solve Bayesian inverse problems: An amortized variational inference approach using Gaussian and Flow guides
- Stein Variational Gradient Descent with Multiple Kernel
- Calibration procedures for approximate Bayesian credible sets
- Gaussian Mixture Reduction with Composite Transportation Divergence
- Bayesian Model Selection for Network Discrimination and Risk-informed Decision Making in Material Flow Analysis
- Partially factorized variational inference for high-dimensional mixed models
- Streamlining Variational Inference for Constraint Satisfaction Problems
- Inferring the Langevin Equation with Uncertainty via Bayesian Neural Networks
- Weakly-supervised Multi-output Regression via Correlated Gaussian Processes
- Single- to multi-fidelity history-dependent learning with uncertainty quantification and disentanglement: application to data-driven constitutive modeling
- Bayesian decomposition of the Galactic multi-frequency sky using probabilistic autoencoders
- vEEGNet: learning latent representations to reconstruct EEG raw data via variational autoencoders
- Improvement and generalization of ABCD method with Bayesian inference
- Bayesian sparsification for deep neural networks with Bayesian model reduction
- A Note on Improving Variational Estimation for Multidimensional Item Response Theory
- Variational mean-field theory for training restricted Boltzmann machines with binary synapses
- The interplay between ranking and communities in networks
- All you need is spin: SU(2) equivariant variational quantum circuits based on spin networks
- A Bayesian Gaussian Process-Based Latent Discriminative Generative Decoder (LDGD) Model for High-Dimensional Data
- Simulation-Based Inference of Surface Accumulation and Basal Melt Rates of an Antarctic Ice Shelf from Isochronal Layers
- Variational Autoencoder Kernel Interpretation and Selection for Classification
- The missing radial velocities of Gaia: a catalogue of Bayesian estimates for DR3
- Informative Bayesian model selection for RR Lyrae star classifiers
- Indoor thermal comfort management: A Bayesian machine-learning approach to data denoising and dynamics prediction of HVAC systems
- Non-centered parametric variational Bayes' approach for hierarchical inverse problems of partial differential equations
- Principled Pruning of Bayesian Neural Networks through Variational Free Energy Minimization
- An Information Theory Approach on Deciding Spectroscopic Follow Ups
- Variational Inference and Sparsity in High-Dimensional Deep Gaussian Mixture Models
- Generative AI for Brane Configurations and Coamoeba
- Semi-supervised empirical Bayes group-regularized factor regression
- Molecular Dynamics and Machine Learning Unlock Possibilities in Beauty Design -- A Perspective
- Return to Lacan: an approach to digital twin mind with free energy principle
- Variational Bayesian surrogate modelling with application to robust design optimisation
- jaxspec : a fast and robust Python library for X-ray spectral fitting
- Unsupervised detection of coordinated information operations in the wild
- Nearly Consistent Finite Particle Estimates in Streaming Importance Sampling
- Reconstructing Sparse Multiplex Networks with Application to Covert Networks
- First look at Vela X-1 with XRISM: A simultaneous campaign with XMM-Newton and NuSTAR
- CSI Clustering with Variational Autoencoding
- Bayesian RG Flow in Neural Network Field Theories
- Bayesian Neural Networks for Virtual Flow Metering: An Empirical Study
- Revisiting Group Differences in High-Dimensional Choices: Method and Application to Congressional Speech
- Large-Scale Joint Topic, Sentiment & User Preference Analysis for Online Reviews
- Federated Bayesian Deep Learning: The Application of Statistical Aggregation Methods to Bayesian Models
- Inferring the density and membership of stellar streams with flexible models: The GD-1 stream in Gaia Data Release 3
- Towards Bayesian Data Compression
- Unifying supervised learning and VAEs -- coverage, systematics and goodness-of-fit in normalizing-flow based neural network models for astro-particle reconstructions
- PAC-Bayes Bounds for Bandit Problems: A Survey and Experimental Comparison
- A Two-Stage Bayesian Semiparametric Model for Novelty Detection with Robust Prior Information
- The sociospatial factors of death: Analyzing effects of geospatially-distributed variables in a Bayesian mortality model for Hong Kong
- Enhancing Dynamical System Modeling through Interpretable Machine Learning Augmentations: A Case Study in Cathodic Electrophoretic Deposition
- Bayesian Reasoning with Trained Neural Networks
- Multi-Physics-Enhanced Bayesian Inverse Analysis: Information Gain from Additional Fields
- Conformal Quantile Regression for Neural Probabilistic Constitutive Modeling
- Ordinal Outcome State-Space Models for Intensive Longitudinal Data
- Monte Carlo inference for semiparametric Bayesian regression
- Gaussbock: Fast parallel-iterative cosmological parameter estimation with Bayesian nonparametrics
- Manifold Sampling for Differentiable Uncertainty in Radiance Fields
- VARADE: a Variational-based AutoRegressive model for Anomaly Detection on the Edge
- Uncertainty Quantification of Graph Convolution Neural Network Models of Evolving Processes
- Nonparametric Bayesian volatility estimation
- TABASCAL: Removing multi-satellite interference from radio interferometry observations
- Computationally efficient variational-like approximations of possibilistic inferential models
- Leveraging Normalizing Flows for Orbital-Free Density Functional Theory
- A Bayesian Fisher-EM algorithm for discriminative Gaussian subspace clustering
- Interrogating probabilistic inversion results for subsurface structural information
- Uncertainties of Satellite-based Essential Climate Variables from Deep Learning
- Causality-aware Graph Aggregation Weight Estimator for Popularity Debiasing in Top-K Recommendation
- A Statistical Model of Bipartite Networks: Application to Cosponsorship in the United States Senate
- Maximum Probability Theorem: A Framework for Probabilistic Learning
- Bayesian Experimental Design for Model Discrepancy Calibration: A Rivalry between Kullback--Leibler Divergence and Wasserstein Distance
- Greedy clustering of count data through a mixture of multinomial PCA
- Temporal Latent Variable Structural Causal Model for Causal Discovery under External Interferences
- Leveraging Active Subspaces to Capture Epistemic Model Uncertainty in Deep Generative Models for Molecular Design
- Self-supervised Latent Space Optimization with Nebula Variational Coding
- A Concise Mathematical Description of Active Inference in Discrete Time
- Hierarchical mixtures of Unigram models for short text clustering: The role of Beta-Liouville priors
- Policy Gradient Approach to Compilation of Variational Quantum Circuits
- Variational Inference for the Latent Shrinkage Position Model
- Deep mixture of linear mixed models for complex longitudinal data
- Deep learning and differential equations for modeling changes in individual-level latent dynamics between observation periods
- Gaussian Mixture Reduction for Time-Constrained Approximate Inference in Hybrid Bayesian Networks
- Bayesian Joint Chance Constrained Optimization: Approximations and Statistical Consistency
- Seeded Poisson Factorization: leveraging domain knowledge to fit topic models
- Bayesian Experimental Design for Model Discrepancy Calibration: An Auto-Differentiable Ensemble Kalman Inversion Approach
- Generalized Decomposition Priors on R2
- Composite likelihood inference for the Poisson log-normal model
- Variational Inference for Quantum HyperNetworks
- Towards Generative Location Awareness for Disaster Response: A Probabilistic Cross-view Geolocalization Approach
- The Renyi Gaussian Process: Towards Improved Generalization
- Simultaneous inference of periods and period-luminosity relations for Mira variable stars
- PAC-Bayes Bounds on Variational Tempered Posteriors for Markov Models
- Symmetry-driven embedding of networks in hyperbolic space
- Noncooperative dynamics in election interference
- R-VGAL: A Sequential Variational Bayes Algorithm for Generalised Linear Mixed Models
- Learn Quasi-stationary Distributions of Finite State Markov Chain
- Posterior Collapse as a Phase Transition in Variational Autoencoders
- Evaluating Negative Sampling Approaches for Neural Topic Models
- Alpha-VI DeepONet: A prior-robust variational Bayesian approach for enhancing DeepONets with uncertainty quantification
- Properties and Bayesian fitting of restricted Boltzmann machines
- Gradient-Free Score-Based Sampling Methods with Ensembles
- Modelling variability in vibration-based PBSHM via a generalised population form
- Doubly Adaptive Importance Sampling
- Probabilistic partition of unity networks for high-dimensional regression problems
- Tightening the Biological Constraints on Gradient-Based Predictive Coding
- Uncertainty quantification for White Matter Hyperintensity segmentation detects silent failures and improves automated Fazekas quantification
- On the Impact of Sampling on Deep Sequential State Estimation
- The Price equation reveals a universal force-metric-bias law of algorithmic learning and natural selection
- ProBoost: a Boosting Method for Probabilistic Classifiers
- A Bayesian Nonparametric Stochastic Block Model for Directed Acyclic Graphs
- On the Consistency of a Random Forest Algorithm in the Presence of Missing Entries
- Tuning Random Generators: Property-Based Testing as Probabilistic Programming
- Bayesian Models Applied to Cyber Security Anomaly Detection Problems
- MFAI: A Scalable Bayesian Matrix Factorization Approach to Leveraging Auxiliary Information
- Quantifying imperfect cognition via achieved information gain
- Variational Bayes latent class approach for EHR-based phenotyping with large real-world data
- Regularized Bayesian calibration and scoring of the WD-FAB IRT model improves predictive performance over marginal maximum likelihood
- Active Inference Meeting Energy-Efficient Control of Parallel and Identical Machines
- Programming with Neural Surrogates of Programs
- Bayesian neural networks with interpretable priors from Mercer kernels
- Unsupervised Bayesian classification for models with scalar and functional covariates
- Testing Homogeneity for Normal Mixture Models: Variational Bayes Approach
- The Bayesian Method of Tensor Networks
- Data-driven modeling of time-domain induced polarization
- Scalable Variational Inference for Multinomial Probit Models under Large Choice Sets and Sample Sizes
- Adversarial Disentanglement by Backpropagation with Physics-Informed Variational Autoencoder
- Importance sampling-based gradient method for dimension reduction in Poisson log-normal model
- Navigating Uncertainties in Machine Learning for Structural Dynamics: A Comprehensive Survey of Probabilistic and Non-Probabilistic Approaches in Forward and Inverse Problems
- Statistical Inferences and Predictions for Areal Data and Spatial Data Fusion with Hausdorff--Gaussian Processes
- Random Spiking and Systematic Evaluation of Defenses Against Adversarial Examples
- An Application to Generate Style Guided Compatible Outfit
- Efficacy Analysis in Clinical Trials: A Comprehensive Review of Statistical and Machine Learning Approaches
- A Framework for the Bayesian Calibration of Complex and Data-Scarce Models in Applied Sciences
- Prediction of Diffusion Coefficients in Mixtures with Tensor Completion
- Advances in Neural 3D Mesh Texturing: A Survey
- Automated Movement Detection with Dirichlet Process Mixture Models and Electromyography
- MLMOD: Machine Learning Methods for Data-Driven Modeling in LAMMPS
- EvoVGM: a Deep Variational Generative Model for Evolutionary Parameter Estimation
- Tightening Bounds for Variational Inference by Revisiting Perturbation Theory
- Non-conjugate variational Bayes for pseudo-likelihood mixed effect models
- CALF-SBM: A Covariate-Assisted Latent Factor Stochastic Block Model
- Rapid Risk Minimization with Bayesian Models Through Deep Learning Approximation
- Probabilistic Latent Factor Model for Collaborative Filtering with Bayesian Inference
- Generative multi-scale modeling via spatial autoregressive transport maps
- A Bayesian approach to aggregated chemical exposure assessment
- Efficient Iterative Proximal Variational Inference Motion Planning
- Law of Large Numbers for Bayesian two-layer Neural Network trained with Variational Inference
- A PAC-Bayes oracle inequality for sparse neural networks
- Evolving Voices Based on Temporal Poisson Factorisation
- Probabilistic Registration for Gaussian Process 3D shape modelling in the presence of extensive missing data
- Covariate-Elaborated Robust Partial Information Transfer with Conditional Spike-and-Slab Prior
- Group Spike and Slab Variational Bayes
- Probabilistic Zeeman-Doppler imaging of stellar magnetic fields: I. Analysis of tau Scorpii in the weak-field limit
- Variational inference for hierarchical models with conditional scale and skewness corrections
- Improving the convergence of Markov chains via permutations and projections
- Fast Sampling of Cosmological Initial Conditions with Gaussian Neural Posterior Estimation
- Auto-encoding GPS data to reveal individual and collective behaviour