Multivariate Bernoulli distribution

Abstract

In this paper, we consider the multivariate Bernoulli distribution as a model to estimate the structure of graphs with binary nodes. This distribution is discussed in the framework of the exponential family, and its statistical properties regarding independence of the nodes are demonstrated. Importantly the model can estimate not only the main effects and pairwise interactions among the nodes but also is capable of modeling higher order interactions, allowing for the existence of complex clique effects. We compare the multivariate Bernoulli model with existing graphical inference models - the Ising model and the multivariate Gaussian model, where only the pairwise interactions are considered. On the other hand, the multivariate Bernoulli distribution has an interesting property in that independence and uncorrelatedness of the component random variables are equivalent. Both the marginal and conditional distributions of a subset of variables in the multivariate Bernoulli distribution still follow the multivariate Bernoulli distribution. Furthermore, the multivariate Bernoulli logistic model is developed under generalized linear model theory by utilizing the canonical link function in order to include covariate information on the nodes, edges and cliques. We also consider variable selection techniques such as LASSO in the logistic model to impose sparsity structure on the graph. Finally, we discuss extending the smoothing spline ANOVA approach to the multivariate Bernoulli logistic model to enable estimation of non-linear effects of the predictor variables.

Published in at http://dx.doi.org/10.3150/12-BEJSP10 the Bernoulli (http://isi.cbs.nl/bernoulli/) by the International Statistical Institute/Bernoulli Society (http://isi.cbs.nl/BS/bshome.htm)

References in corpus (2)

• High-dimensional Ising model selection using ${\ell }_1$-regularized logistic regression
• Nonconcave penalized composite conditional likelihood estimation of sparse Ising models

Cited by in corpus (21)

• Re-evaluation of the comparative effectiveness of bootstrap-based optimism correction methods in the development of multivariable clinical prediction models
• Cell assemblies at multiple time scales with arbitrary lag constellations
• Differential protein expression and peak selection in mass spectrometry data by binary discriminant analysis
• Decentralized and Collaborative Subspace Pursuit: A Communication-Efficient Algorithm for Joint Sparsity Pattern Recovery with Sensor Networks
• Robust Graph Filter Identification and Graph Denoising from Signal Observations
• Community detection and reciprocity in networks by jointly modeling pairs of edges
• Availability, outage, and capacity of spatially correlated, Australasian free-space optical networks
• Decision-making with multiple correlated binary outcomes in clinical trials
• Hoeffding adaptive trees for multi-label classification on data streams
• Bayesian multilevel multivariate logistic regression for superiority decision-making under observable treatment heterogeneity
• On maximum-likelihood decoding with circuit-level errors
• Probabilistic Forecasting in Day-Ahead Electricity Markets: Simulating Peak and Off-Peak Prices
• COVID-19 Clinical footprint to infer about mortality
• Measuring Rule-based LTLf Process Specifications: A Probabilistic Data-driven Approach
• On Construction and Estimation of Stationary Mixture Transition Distribution Models
• Robust Design of Reconfigurable Intelligent Surfaces for Parameter Estimation in MTC
• On finite-population Bayesian inferences for $2^K$ factorial designs with binary outcomes
• Multivariate binary probability distribution in the Grassmann formalism
• Learning binary undirected graph in low dimensional regime
• Anomaly, reciprocity, and community detection in networks
• Bayesian multivariate logistic regression for superiority and inferiority decision-making under observable treatment heterogeneity