3 papers
cs.LG2025
Resolving Conflicts in Lifelong Learning via Aligning Updates in Subspaces
Yueer Zhou, Yichen Wu, Ying Wei
Low-Rank Adaptation (LoRA) enables efficient Continual Learning but often suffers from catastrophic forgetting due to destructive interference between tasks. Our analysis reveals t…
cs.LG2025
Mixture of Low Rank Adaptation with Partial Parameter Sharing for Time Series Forecasting
Licheng Pan, Zhichao Chen, Haoxuan Li +5
Multi-task forecasting has become the standard approach for time-series forecasting (TSF). However, we show that it suffers from an Expressiveness Bottleneck, where predictions at…
cs.LG2025
SD-LoRA: Scalable Decoupled Low-Rank Adaptation for Class Incremental Learning
Yichen Wu, Hongming Piao, Long-Kai Huang +6
Continual Learning (CL) with foundation models has recently emerged as a promising paradigm to exploit abundant knowledge acquired during pre-training for tackling sequential tasks…