MOON: Multi-Objective OrthoNormalized Updates for Multitask Learning

Shiji Zhou, Kunlin Lyu, Lei Zhang +2

Multi-objective optimization (MOO) has demonstrated significant success in multi-task learning by mitigating task conflicts through gradient manipulation. However, most existing me…