A Foliated View of Transfer Learning
arXiv:2008.00546
Abstract
Transfer learning considers a learning process where a new task is solved by transferring relevant knowledge from known solutions to related tasks. While this has been studied experimentally, there lacks a foundational description of the transfer learning problem that exposes what related tasks are, and how they can be exploited. In this work, we present a definition for relatedness between tasks and identify foliations as a mathematical framework to represent such relationships.
arXiv comment14 pages, 6 figures
References in corpus (9)
- Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks
- Prototypical Networks for Few-shot Learning
- An Overview of Multi-Task Learning in Deep Neural Networks
- An Empirical Investigation of Catastrophic Forgetting in Gradient-Based Neural Networks
- What makes ImageNet good for transfer learning?
- A Closer Look at Few-shot Classification
- Rethinking Few-Shot Image Classification: a Good Embedding Is All You Need?
- Meta-Learning Symmetries by Reparameterization
- Disentangled Skill Embeddings for Reinforcement Learning