Can Optimization Trajectories Explain Multi-Task Transfer?

David Mueller, Mark Dredze, Nicholas Andrews

Despite the widespread adoption of multi-task training in deep learning, little is understood about how multi-task learning (MTL) affects generalization. Prior work has conjectured…