Improvable Gap Balancing for Multi-Task Learning

Yanqi Dai, Nanyi Fei, Zhiwu Lu

In multi-task learning (MTL), gradient balancing has recently attracted more research interest than loss balancing since it often leads to better performance. However, loss balanci…