Domain Adaptation for Time-Series Classification to Mitigate Covariate Shift
arXiv:2204.03342 · doi:10.1145/3503161.3548167
Abstract
The performance of a machine learning model degrades when it is applied to data from a similar but different domain than the data it has initially been trained on. To mitigate this domain shift problem, domain adaptation (DA) techniques search for an optimal transformation that converts the (current) input data from a source domain to a target domain to learn a domain-invariant representation that reduces domain discrepancy. This paper proposes a novel supervised DA based on two steps. First, we search for an optimal class-dependent transformation from the source to the target domain from a few samples. We consider optimal transport methods such as the earth mover's distance, Sinkhorn transport and correlation alignment. Second, we use embedding similarity techniques to select the corresponding transformation at inference. We use correlation metrics and higher-order moment matching techniques. We conduct an extensive evaluation on time-series datasets with domain shift including simulated and various online handwriting datasets to demonstrate the performance.
References in corpus (2)
Cited by in corpus (10)
- Label-efficient Time Series Representation Learning: A Review
- Benchmarking Online Sequence-to-Sequence and Character-based Handwriting Recognition from IMU-Enhanced Pens
- Auxiliary Cross-Modal Representation Learning with Triplet Loss Functions for Online Handwriting Recognition
- Few-Shot Learning with Uncertainty-based Quadruplet Selection for Interference Classification in GNSS Data
- Evaluation of (Un-)Supervised Machine Learning Methods for GNSS Interference Classification with Real-World Data Discrepancies
- Online Handwriting Trajectory Reconstruction from Kinematic Sensors using Temporal Convolutional Network
- Mixture-of-experts for handwriting trajectory reconstruction from IMU sensors
- Representation Learning for Tablet and Paper Domain Adaptation in Favor of Online Handwriting Recognition
- Evaluating ML Robustness in GNSS Interference Classification, Characterization & Localization
- 5G-DIL: Domain Incremental Learning with Similarity-Aware Sampling for Dynamic 5G Indoor Localization