Dempster--Shafer Theory and Statistical Inference with Weak Beliefs

Abstract

The Dempster--Shafer (DS) theory is a powerful tool for probabilistic reasoning based on a formal calculus for combining evidence. DS theory has been widely used in computer science and engineering applications, but has yet to reach the statistical mainstream, perhaps because the DS belief functions do not satisfy long-run frequency properties. Recently, two of the authors proposed an extension of DS, called the weak belief (WB) approach, that can incorporate desirable frequency properties into the DS framework by systematically enlarging the focal elements. The present paper reviews and extends this WB approach. We present a general description of WB in the context of inferential models, its interplay with the DS calculus, and the maximal belief solution. New applications of the WB method in two high-dimensional hypothesis testing problems are given. Simulations show that the WB procedures, suitably calibrated, perform well compared to popular classical methods. Most importantly, the WB approach combines the probabilistic reasoning of DS with the desirable frequency properties of classical statistics.

Published in at http://dx.doi.org/10.1214/10-STS322 the Statistical Science (http://www.imstat.org/sts/) by the Institute of Mathematical Statistics (http://www.imstat.org)

References in corpus (2)

• Stochastic Approximation and Newton's Estimate of a Mixing Distribution
• Estimating limits from Poisson counting data using Dempster--Shafer analysis

Cited by in corpus (11)

• Inferential models: A framework for prior-free posterior probabilistic inference
• Marginal inferential models: prior-free probabilistic inference on interest parameters
• Fiducial theory and optimal inference
• Frameworks for prior-free posterior probabilistic inference
• Parameter Expansion and Efficient Inference
• Discussion: Foundations of Statistical Inference, Revisited
• Random sets and exact confidence regions
• Uncertainty Quantification for High Dimensional Sparse Nonparametric Additive Models
• AutoGFI: Streamlined Generalized Fiducial Inference for Modern Inference Problems in Models with Additive Errors
• Discussion of "On the Birnbaum Argument for the Strong Likelihood Principle"
• Partial Conditioning for Inference of Many-Normal-Means with Hölder Constraints