2 papers
cs.LG2026
LoopFM: Learning frOm HistOrical RePresentations of Foundation Model for Recommendation
Shali Jiang, Hua Zheng, Boyang Liu +40
Knowledge distillation (KD) transfers a single scalar prediction from a large foundation model (FM) to compact vertical models (VMs), suffering from diminishing transfer ratio -- t…
cs.LG2026
Feed m Birds with One Scone: Accelerating Multi-task Gradient Balancing via Bi-level Optimization
Xuxing Chen, Yun He, Jiayi Xu +9
In machine learning, the goal of multi-task learning (MTL) is to optimize multiple objectives together. Recent works, for example, Multiple Gradient Descent Algorithm (MGDA) and it…