Fusion of Probability Density Functions

Abstract

Fusing probabilistic information is a fundamental task in signal and data processing with relevance to many fields of technology and science. In this work, we investigate the fusion of multiple probability density functions (pdfs) of a continuous random variable or vector. Although the case of continuous random variables and the problem of pdf fusion frequently arise in multisensor signal processing, statistical inference, and machine learning, a universally accepted method for pdf fusion does not exist. The diversity of approaches, perspectives, and solutions related to pdf fusion motivates a unified presentation of the theory and methodology of the field. We discuss three different approaches to fusing pdfs. In the axiomatic approach, the fusion rule is defined indirectly by a set of properties (axioms). In the optimization approach, it is the result of minimizing an objective function that involves an information-theoretic divergence or a distance measure. In the supra-Bayesian approach, the fusion center interprets the pdfs to be fused as random observations. Our work is partly a survey, reviewing in a structured and coherent fashion many of the concepts and methods that have been developed in the literature. In addition, we present new results for each of the three approaches. Our original contributions include new fusion rules, axioms, and axiomatic and optimization-based characterizations; a new formulation of supra-Bayesian fusion in terms of finite-dimensional parametrizations; and a study of supra-Bayesian fusion of posterior pdfs for linear Gaussian models.

References in corpus (24)

• Federated Learning: Challenges, Methods, and Future Directions
• Popular Ensemble Methods: An Empirical Study
• A Review of Uncertainty Quantification in Deep Learning: Techniques, Applications and Challenges
• Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learning
• Rényi Divergence and Kullback-Leibler Divergence
• Federated Learning with Cooperating Devices: A Consensus Approach for Massive IoT Networks
• Bayesian SegNet: Model Uncertainty in Deep Convolutional Encoder-Decoder Architectures for Scene Understanding
• Bayesian model averaging: A systematic review and conceptual classification
• Agnostic Federated Learning
• Second Order Statistics Analysis and Comparison between Arithmetic and Geometric Average Fusion
• On Markov chain Monte Carlo methods for tall data
• Robust Distributed Fusion with Labeled Random Finite Sets
• Partial Consensus and Conservative Fusion of Gaussian Mixtures for Distributed PHD Fusion
• A Distributed Particle-PHD Filter with Arithmetic-Average PHD Fusion
• Parallelizing MCMC via Weierstrass Sampler
• Bayesian machine learning for quantum molecular dynamics
• Fusion of labeled RFS densities with minimum information loss
• Mixture EMOS model for calibrating ensemble forecasts of wind speed
• Expectation propagation as a way of life: A framework for Bayesian inference on partitioned data
• Consensus Labeled Random Finite Set Filtering for Distributed Multi-Object Tracking
• On $f$-Divergences: Integral Representations, Local Behavior, and Inequalities
• The curse of dimensionality for numerical integration on general domains
• Minimax Robust Detection: Classic Results and Recent Advances
• A Consensual Linear Opinion Pool

Cited by in corpus (12)

• Arithmetic Average Density Fusion -- Part II: Unified Derivation for Unlabeled and Labeled RFS Fusion
• Arithmetic Average Density Fusion -- Part I: Some Statistic and Information-theoretic Results
• Multi-sensor Suboptimal Fusion Student's $t$ Filter
• Arithmetic Average Density Fusion -- Part IV: Distributed Heterogeneous Fusion of RFS and LRFS Filters via Variational Approximation
• Combining Federated Learning and Control: A Survey
• Fusion of Gaussian Processes Predictions with Monte Carlo Sampling
• Federated Bayesian Deep Learning: The Application of Statistical Aggregation Methods to Bayesian Models
• Doeblin Coefficients and Related Measures
• A Modular Approach to Automatic Cyber Threat Attribution using Opinion Pools
• Enhancing Morpho-Kinematic analysis for Plant Water Stress Classification through Leaf Movements
• CUQ-GNN: Committee-based Graph Uncertainty Quantification using Posterior Networks
• A reliability data aggregation method for fusion-oriented research facilities