Showing cs.LGShow all
2 papers · 1 filter
cs.LG2026
Feed m Birds with One Scone: Accelerating Multi-task Gradient Balancing via Bi-level Optimization
Xuxing Chen, Yun He, Jiayi Xu +9
In machine learning, the goal of multi-task learning (MTL) is to optimize multiple objectives together. Recent works, for example, Multiple Gradient Descent Algorithm (MGDA) and it…
cs.LG2025
APOLLO: SGD-like Memory, AdamW-level Performance
Hanqing Zhu, Zhenyu Zhang, Wenyan Cong +7
Large language models (LLMs) are notoriously memory-intensive during training, particularly with the popular AdamW optimizer. This memory burden necessitates using more or higher-e…