Generalizing to Unseen Domains: A Survey on Domain Generalization

Abstract

Machine learning systems generally assume that the training and testing distributions are the same. To this end, a key requirement is to develop models that can generalize to unseen distributions. Domain generalization (DG), i.e., out-of-distribution generalization, has attracted increasing interests in recent years. Domain generalization deals with a challenging setting where one or several different but related domain(s) are given, and the goal is to learn a model that can generalize to an unseen test domain. Great progress has been made in the area of domain generalization for years. This paper presents the first review of recent advances in this area. First, we provide a formal definition of domain generalization and discuss several related fields. We then thoroughly review the theories related to domain generalization and carefully analyze the theory behind generalization. We categorize recent algorithms into three classes: data manipulation, representation learning, and learning strategy, and present several popular algorithms in detail for each category. Third, we introduce the commonly used datasets, applications, and our open-sourced codebase for fair evaluation. Finally, we summarize existing literature and present some potential research topics for the future.

Accepted by IEEE Trans. on Knowledge and Data Engineering (TKDE); 19 pages; short version (6 pages) is accepted by IJCAI-21 survey track; codebase: https://github.com/jindongwang/transferlearning/tree/master/code/DeepDG

Cited by in corpus (7)

• Learning Disentangled Representations in the Imaging Domain
• AADG: Automatic Augmentation for Domain Generalization on Retinal Image Segmentation
• Improving Generalizability of Graph Anomaly Detection Models via Data Augmentation
• Robust Domain Misinformation Detection via Multi-modal Feature Alignment
• Camera Adaptation for Fundus-Image-Based CVD Risk Estimation
• Domain generalization of 3D semantic segmentation in autonomous driving
• Effect-Invariant Mechanisms for Policy Generalization