Logistic Regression, Neural Networks and Dempster-Shafer Theory: a New Perspective
arXiv:1807.01846 · doi:10.1016/j.knosys.2019.03.030
Abstract
We revisit logistic regression and its nonlinear extensions, including multilayer feedforward neural networks, by showing that these classifiers can be viewed as converting input or higher-level features into Dempster-Shafer mass functions and aggregating them by Dempster's rule of combination. The probabilistic outputs of these classifiers are the normalized plausibilities corresponding to the underlying combined mass function. This mass function is more informative than the output probability distribution. In particular, it makes it possible to distinguish between lack of evidence (when none of the features provides discriminant information) from conflicting evidence (when different features support different classes). This expressivity of mass functions allows us to gain insight into the role played by each input feature in logistic regression, and to interpret hidden unit outputs in multilayer neural networks. It also makes it possible to use alternative decision rules, such as interval dominance, which select a set of classes when the available evidence does not unambiguously point to a single class, thus trading reduced error rate for higher imprecision.
References in corpus (1)
Cited by in corpus (10)
- An evidential classifier based on Dempster-Shafer theory and deep learning
- Lymphoma segmentation from 3D PET-CT images using a deep evidential network
- Evidential fully convolutional network for semantic segmentation
- EGMM: an Evidential Version of the Gaussian Mixture Model for Clustering
- Application of belief functions to medical image segmentation: A review
- From Shallow to Deep Interactions Between Knowledge Representation, Reasoning and Machine Learning (Kay R. Amel group)
- Evidential Sparsification of Multimodal Latent Spaces in Conditional Variational Autoencoders
- Visual hallucination detection in large vision-language models via evidential conflict
- Bayesian Neural Networks with Soft Evidence
- Fusion of neural networks, for LIDAR-based evidential road mapping