Factorizable Joint Shift in Multinomial Classification

Abstract

Factorizable joint shift (FJS) was recently proposed as a type of dataset shift for which the complete characteristics can be estimated from feature data observations on the test dataset by a method called Joint Importance Aligning. For the multinomial (multiclass) classification setting, we derive a representation of factorizable joint shift in terms of the source (training) distribution, the target (test) prior class probabilities and the target marginal distribution of the features. On the basis of this result, we propose alternatives to joint importance aligning and, at the same time, point out that factorizable joint shift is not fully identifiable if no class label information on the test dataset is available and no additional assumptions are made. Other results of the paper include correction formulae for the posterior class probabilities both under general dataset shift and factorizable joint shift. In addition, we investigate the consequences of assuming factorizable joint shift for the bias caused by sample selection.

arXiv comment24 pages

References in corpus (7)

• Detecting and Correcting for Label Shift with Black Box Predictors
• Domain Adaptation with Conditional Distribution Matching and Generalized Label Shift
• The role of the information set for forecasting - with applications to risk management
• Support and Invertibility in Domain-Invariant Representations
• Class Prior Estimation under Covariate Shift: No Problem?
• A Generalized Neyman-Pearson Criterion for Optimal Domain Adaptation
• Domain Adaptation with Factorizable Joint Shift

Cited by in corpus (2)

• Sparse joint shift in multinomial classification
• Factorizable joint shift revisited