Regularizing Deep Multi-Task Networks using Orthogonal Gradients

Mihai Suteu, Yike Guo

Deep neural networks are a promising approach towards multi-task learning because of their capability to leverage knowledge across domains and learn general purpose representations…