The role of the information set for forecasting - with applications to risk management
arXiv:1404.7653 · doi:10.1214/13-AOAS709
Abstract
Predictions are issued on the basis of certain information. If the forecasting mechanisms are correctly specified, a larger amount of available information should lead to better forecasts. For point forecasts, we show how the effect of increasing the information set can be quantified by using strictly consistent scoring functions, where it results in smaller average scores. Further, we show that the classical Diebold-Mariano test, based on strictly consistent scoring functions and asymptotically ideal forecasts, is a consistent test for the effect of an increase in a sequence of information sets on -step point forecasts. For the value at risk (VaR), we show that the average score, which corresponds to the average quantile risk, directly relates to the expected shortfall. Thus, increasing the information set will result in VaR forecasts which lead on average to smaller expected shortfalls. We illustrate our results in simulations and applications to stock returns for unconditional versus conditional risk management as well as univariate modeling of portfolio returns versus multivariate modeling of individual risk factors. The role of the information set for evaluating probabilistic forecasts by using strictly proper scoring rules is also discussed.
Published in at http://dx.doi.org/10.1214/13-AOAS709 the Annals of Applied Statistics (http://www.imstat.org/aoas/) by the Institute of Mathematical Statistics (http://www.imstat.org)
Cited by in corpus (11)
- Regression Diagnostics meets Forecast Evaluation: Conditional Calibration, Reliability Diagrams, and Coefficient of Determination
- Sensitivity Measures Based on Scoring Functions
- Backtesting Systemic Risk Forecasts using Multi-Objective Elicitability
- Proper Scoring Rules for Multivariate Probabilistic Forecasts based on Aggregation and Transformation
- Calibrating sufficiently
- Measurability of functionals and of ideal point forecasts
- Enhancing the statistical evaluation of earthquake forecasts -- An application to Italy
- Factorizable Joint Shift in Multinomial Classification
- Warnings based on risk matrices: a coherent framework with consistent evaluation
- Sparse joint shift in multinomial classification
- Factorizable joint shift revisited