Domain Generalization under Conditional and Label Shifts via Variational Bayesian Inference

Abstract

In this work, we propose a domain generalization (DG) approach to learn on several labeled source domains and transfer knowledge to a target domain that is inaccessible in training. Considering the inherent conditional and label shifts, we would expect the alignment of $p(x|y)$ and $p(y)$. However, the widely used domain invariant feature learning (IFL) methods relies on aligning the marginal concept shift w.r.t. $p(x)$, which rests on an unrealistic assumption that $p(y)$ is invariant across domains. We thereby propose a novel variational Bayesian inference framework to enforce the conditional distribution alignment w.r.t. $p(x|y)$ via the prior distribution matching in a latent space, which also takes the marginal label shift w.r.t. $p(y)$ into consideration with the posterior alignment. Extensive experiments on various benchmarks demonstrate that our framework is robust to the label shift and the cross-domain accuracy is significantly improved, thereby achieving superior performance over the conventional IFL counterparts.

30th International Joint Conference on Artificial Intelligence (IJCAI) 2021

References in corpus (7)

• DeCAF: A Deep Convolutional Activation Feature for Generic Visual Recognition
• Generalizing Across Domains via Cross-Gradient Training
• An introduction to domain adaptation and transfer learning
• On Causal and Anticausal Learning
• Importance Weighting and Variational Inference
• Causal Generative Domain Adaptation Networks
• Subtype-aware Unsupervised Domain Adaptation for Medical Diagnosis