Adaptively-Accumulated Knowledge Transfer for Partial Domain Adaptation
arXiv:2008.11873
Abstract
Partial domain adaptation (PDA) attracts appealing attention as it deals with a realistic and challenging problem when the source domain label space substitutes the target domain. Most conventional domain adaptation (DA) efforts concentrate on learning domain-invariant features to mitigate the distribution disparity across domains. However, it is crucial to alleviate the negative influence caused by the irrelevant source domain categories explicitly for PDA. In this work, we propose an Adaptively-Accumulated Knowledge Transfer framework (AKT) to align the relevant categories across two domains for effective domain adaptation. Specifically, an adaptively-accumulated mechanism is explored to gradually filter out the most confident target samples and their corresponding source categories, promoting positive transfer with more knowledge across two domains. Moreover, a dual distinct classifier architecture consisting of a prototype classifier and a multilayer perceptron classifier is built to capture intrinsic data distribution knowledge across domains from various perspectives. By maximizing the inter-class center-wise discrepancy and minimizing the intra-class sample-wise compactness, the proposed model is able to obtain more domain-invariant and task-specific discriminative representations of the shared categories data. Comprehensive experiments on several partial domain adaptation benchmarks demonstrate the effectiveness of our proposed model, compared with the state-of-the-art PDA methods.
References in corpus (9)
- Very Deep Convolutional Networks for Large-Scale Image Recognition
- Prototypical Networks for Few-shot Learning
- DeCAF: A Deep Convolutional Activation Feature for Generic Visual Recognition
- How transferable are features in deep neural networks?
- Learning Transferable Features with Deep Adaptation Networks
- Unsupervised Domain Adaptation with Residual Transfer Networks
- CyCADA: Cycle-Consistent Adversarial Domain Adaptation
- LSDA: Large Scale Detection Through Adaptation
- Deep Residual Correction Network for Partial Domain Adaptation