A Brief Review of Deep Multi-task Learning and Auxiliary Task Learning

Abstract

Multi-task learning (MTL) optimizes several learning tasks simultaneously and leverages their shared information to improve generalization and the prediction of the model for each task. Auxiliary tasks can be added to the main task to ultimately boost the performance. In this paper, we provide a brief review on the recent deep multi-task learning (dMTL) approaches followed by methods on selecting useful auxiliary tasks that can be used in dMTL to improve the performance of the model for the main task.

References in corpus (9)

• An Overview of Multi-Task Learning in Deep Neural Networks
• The Cityscapes Dataset for Semantic Urban Scene Understanding
• Multi-Task Learning Using Uncertainty to Weigh Losses for Scene Geometry and Semantics
• Massively Multitask Networks for Drug Discovery
• The Natural Language Decathlon: Multitask Learning as Question Answering
• Adapting Auxiliary Losses Using Gradient Similarity
• Auxiliary Learning for Deep Multi-task Learning
• AutoSeM: Automatic Task Selection and Mixing in Multi-Task Learning
• Empirical Evaluation of Multi-task Learning in Deep Neural Networks for Natural Language Processing