TBGC: Task-level Backbone-Oriented Gradient Clip for Multi-Task Foundation Model Learning

Zelun Zhang, Xue Pan

The AllInOne training paradigm squeezes a wide range of tasks into a unified model in a multi-task learning manner. However, optimization in multi-task learning is more challenge t…