Variational inference for large-scale models of discrete choice

Abstract

Discrete choice models are commonly used by applied statisticians in numerous fields, such as marketing, economics, finance, and operations research. When agents in discrete choice models are assumed to have differing preferences, exact inference is often intractable. Markov chain Monte Carlo techniques make approximate inference possible, but the computational cost is prohibitive on the large data sets now becoming routinely available. Variational methods provide a deterministic alternative for approximation of the posterior distribution. We derive variational procedures for empirical Bayes and fully Bayesian inference in the mixed multinomial logit model of discrete choice. The algorithms require only that we solve a sequence of unconstrained optimization problems, which are shown to be convex. Extensive simulations demonstrate that variational methods achieve accuracy competitive with Markov chain Monte Carlo, at a small fraction of the computational cost. Thus, variational methods permit inferences on data sets that otherwise could not be analyzed without bias-inducing modifications to the underlying model.

29 pages, 2 tables, 2 figures

References in corpus (1)

• A correlated topic model of Science

Cited by in corpus (40)

• Variational Inference: A Review for Statisticians
• Supervised Topic Models
• Mixed membership stochastic blockmodels
• Hierarchical relational models for document networks
• VIBNN: Hardware Acceleration of Bayesian Neural Networks
• Nonparametric variational inference
• Black Box Variational Inference
• Conditionally conjugate mean-field variational Bayes for logistic models
• Bayesian Estimation of Mixed Multinomial Logit Models: Advances and Simulation-Based Evaluations
• Variational Inference for Generalized Linear Mixed Models Using Partially Noncentered Parametrizations
• A bi-partite generative model framework for analyzing and simulating large scale multiple discrete-continuous travel behaviour data
• Laplace Redux -- Effortless Bayesian Deep Learning
• Variational Inference as an alternative to MCMC for parameter estimation and model selection
• Stochastic variational inference for large-scale discrete choice models using adaptive batch sizes
• Variational inference for sparse spectrum Gaussian process regression
• Variational approximation for mixtures of linear mixed models
• Approximating Bayes in the 21st Century
• Metric Gaussian Variational Inference
• Celeste: Variational inference for a generative model of astronomical images
• Bayesian Conditional Density Filtering
• Approximate Variational Estimation for a Model of Network Formation
• Multi-way blockmodels for analyzing coordinated high-dimensional responses
• The Bayesian Learning Rule
• Variational Bayesian Inference for Mixed Logit Models with Unobserved Inter- and Intra-Individual Heterogeneity
• Topic-adjusted visibility metric for scientific articles
• Variational approximations using Fisher divergence
• Correlated Random Measures
• MAP Clustering under the Gaussian Mixture Model via Mixed Integer Nonlinear Optimization
• The sociospatial factors of death: Analyzing effects of geospatially-distributed variables in a Bayesian mortality model for Hong Kong
• Discrete Choice Analysis with Machine Learning Capabilities
• The Issue-Adjusted Ideal Point Model
• Statistical optimality and stability of tangent transform algorithms in logit models
• Efficient variational inference for generalized linear mixed models with large datasets
• Variational Inference for Category Recommendation in E-Commerce platforms
• Variational Inference in Nonconjugate Models
• Scaling Bayesian inference of mixed multinomial logit models to very large datasets
• Predicting "Design Gaps" in the Market: Deep Consumer Choice Models under Probabilistic Design Constraints
• On the Convergence of Extended Variational Inference for Non-Gaussian Statistical Models
• Semi-Parametric Hierarchical Bayes Estimates of New Yorkers' Willingness to Pay for Features of Shared Automated Vehicle Services
• Scalable Variational Inference for Multinomial Probit Models under Large Choice Sets and Sample Sizes