A risk profile for information fusion algorithms
arXiv:1105.5594 · doi:10.3390/e13081518
Abstract
E.T. Jaynes, originator of the maximum entropy interpretation of statistical mechanics, emphasized that there is an inevitable trade-off between the conflicting requirements of robustness and accuracy for any inferencing algorithm. This is because robustness requires discarding of information in order to reduce the sensitivity to outliers. The principal of nonlinear statistical coupling, which is an interpretation of the Tsallis entropy generalization, can be used to quantify this trade-off. The coupled-surprisal, -ln_k (p)=-(p^k-1)/k, is a generalization of Shannon surprisal or the logarithmic scoring rule, given a forecast p of a true event by an inferencing algorithm. The coupling parameter k=1-q, where q is the Tsallis entropy index, is the degree of nonlinear coupling between statistical states. Positive (negative) values of nonlinear coupling decrease (increase) the surprisal information metric and thereby biases the risk in favor of decisive (robust) algorithms relative to the Shannon surprisal (k=0). We show that translating the average coupled-surprisal to an effective probability is equivalent to using the generalized mean of the true event probabilities as a scoring rule. The metric is used to assess the robustness, accuracy, and decisiveness of a fusion algorithm. We use a two-parameter fusion algorithm to combine input probabilities from N sources. The generalized mean parameter 'alpha' varies the degree of smoothing and raising to a power N^beta with beta between 0 and 1 provides a model of correlation.
arXiv comment15 pages, 4 figures
References in corpus (17)
- Superstatistics
- A possible deformed algebra and calculus inspired in nonextensive thermostatistics
- Generalized information and entropy measures in physics
- Stability of Tsallis antropy and instabilities of Renyi and normalized Tsallis entropies: A basis for q-exponential distributions
- Fundamental properties of Tsallis relative entropy
- Two-parameter deformations of logarithm, exponential, and entropy: A consistent framework for generalized statistical mechanics
- A new one parameter deformation of the exponential function
- Numerical indications of a q-generalised central limit theorem
- Limit distributions of scale-invariant probabilistic models of correlated random variables with the q-Gaussian as an explicit example
- Risk aversion in economic transactions
- Escort mean values and the characterization of power-law-decaying probability densities
- -generalization of Gauss' law of error
- Generalized exponential function and discrete growth models
- Fluctuations, correlations and the nonextensivity
- On the generalized entropy pseudoadditivity for complex systems
- Nonlinear statistical coupling
- Influence of global correlations on central limit theorems and entropic extensivity