Fusion of Probability Density Functions

Abstract

Fusing probabilistic information is a fundamental task in signal and data processing with relevance to many fields of technology and science. In this work, we investigate the fusion of multiple probability density functions (pdfs) of a continuous random variable or vector. Although the case of continuous random variables and the problem of pdf fusion frequently arise in multisensor signal processing, statistical inference, and machine learning, a universally accepted method for pdf fusion does not exist. The diversity of approaches, perspectives, and solutions related to pdf fusion motivates a unified presentation of the theory and methodology of the field. We discuss three different approaches to fusing pdfs. In the axiomatic approach, the fusion rule is defined indirectly by a set of properties (axioms). In the optimization approach, it is the result of minimizing an objective function that involves an information-theoretic divergence or a distance measure. In the supra-Bayesian approach, the fusion center interprets the pdfs to be fused as random observations. Our work is partly a survey, reviewing in a structured and coherent fashion many of the concepts and methods that have been developed in the literature. In addition, we present new results for each of the three approaches. Our original contributions include new fusion rules, axioms, and axiomatic and optimization-based characterizations; a new formulation of supra-Bayesian fusion in terms of finite-dimensional parametrizations; and a study of supra-Bayesian fusion of posterior pdfs for linear Gaussian models.

References in corpus (7)

• Popular Ensemble Methods: An Empirical Study
• A Review of Uncertainty Quantification in Deep Learning: Techniques, Applications and Challenges
• Agnostic Federated Learning
• On Markov chain Monte Carlo methods for tall data
• Bayesian machine learning for quantum molecular dynamics
• Minimax Robust Detection: Classic Results and Recent Advances
• A Consensual Linear Opinion Pool

Cited by in corpus (11)

• Arithmetic Average Density Fusion -- Part II: Unified Derivation for Unlabeled and Labeled RFS Fusion
• Arithmetic Average Density Fusion -- Part I: Some Statistic and Information-theoretic Results
• Multi-sensor Suboptimal Fusion Student's $t$ Filter
• Arithmetic Average Density Fusion -- Part IV: Distributed Heterogeneous Fusion of RFS and LRFS Filters via Variational Approximation
• Combining Federated Learning and Control: A Survey
• Federated Bayesian Deep Learning: The Application of Statistical Aggregation Methods to Bayesian Models
• Fusion of Gaussian Processes Predictions with Monte Carlo Sampling
• Doeblin Coefficients and Related Measures
• A Modular Approach to Automatic Cyber Threat Attribution using Opinion Pools
• Enhancing Morpho-Kinematic analysis for Plant Water Stress Classification through Leaf Movements
• CUQ-GNN: Committee-based Graph Uncertainty Quantification using Posterior Networks