Learning Domain-Invariant Subspace using Domain Features and Independence Maximization

Abstract

Domain adaptation algorithms are useful when the distributions of the training and the test data are different. In this paper, we focus on the problem of instrumental variation and time-varying drift in the field of sensors and measurement, which can be viewed as discrete and continuous distributional change in the feature space. We propose maximum independence domain adaptation (MIDA) and semi-supervised MIDA (SMIDA) to address this problem. Domain features are first defined to describe the background information of a sample, such as the device label and acquisition time. Then, MIDA learns a subspace which has maximum independence with the domain features, so as to reduce the inter-domain discrepancy in distributions. A feature augmentation strategy is also designed to project samples according to their backgrounds so as to improve the adaptation. The proposed algorithms are flexible and fast. Their effectiveness is verified by experiments on synthetic datasets and four real-world ones on sensors, measurement, and computer vision. They can greatly enhance the practicability of sensor systems, as well as extend the application scope of existing domain adaptation algorithms by uniformly handling different kinds of distributional change.

Accepted

References in corpus (3)

• Frustratingly Easy Domain Adaptation
• Marginalized Denoising Autoencoders for Domain Adaptation
• Information-Theoretical Learning of Discriminative Clusters for Unsupervised Domain Adaptation

Cited by in corpus (18)

• A Comprehensive Survey on Transfer Learning
• On The Effects Of Data Normalisation For Domain Adaptation On EEG Data
• Toward cross-subject and cross-session generalization in EEG-based emotion recognition: Systematic review, taxonomy, and methods
• Towards Domain Generalization for ECG and EEG Classification: Algorithms and Benchmarks
• SPIGAN: Privileged Adversarial Learning from Simulation
• Low-Cost Outdoor Air Quality Monitoring and Sensor Calibration: A Survey and Critical Analysis
• Bearing fault diagnosis under varying working condition based on domain adaptation
• Transfer Learning for EEG-Based Brain-Computer Interfaces: A Review of Progress Made Since 2016
• Semi-Generative Modelling: Covariate-Shift Adaptation with Cause and Effect Features
• Domain Independent SVM for Transfer Learning in Brain Decoding
• A Unified Joint Maximum Mean Discrepancy for Domain Adaptation
• Discriminative Cross-Domain Feature Learning for Partial Domain Adaptation
• Learning Domain-invariant Graph for Adaptive Semi-supervised Domain Adaptation with Few Labeled Source Samples
• Shared Space Transfer Learning for analyzing multi-site fMRI data
• Robust Distance Covariance
• TLR: Transfer Latent Representation for Unsupervised Domain Adaptation
• Joint Information Preservation for Heterogeneous Domain Adaptation
• Cheap IR Evaluation: Fewer Topics, No Relevance Judgements, and Crowdsourced Assessments