4 papers
Merge before Forget: A Single LoRA Continual Learning via Continual Merging
Fuli Qiao, Mehrdad Mahdavi
Parameter-efficient continual learning has emerged as a promising approach for large language models (LLMs) to mitigate catastrophic forgetting while enabling adaptation to new tas…
On the Convergence and Stability of Distributed Sub-model Training
Yuyang Deng, Fuli Qiao, Mehrdad Mahdavi
As learning models continue to grow in size, enabling on-device local training of these models has emerged as a critical challenge in federated learning. A popular solution is sub-…
NaviSense: A Multimodal Assistive Mobile application for Object Retrieval by Persons with Visual Impairment
Ajay Narayanan Sridhar, Fuli Qiao, Nelson Daniel Troncoso Aldas +4
People with visual impairments often face significant challenges in locating and retrieving objects in their surroundings. Existing assistive technologies present a trade-off: syst…
Stochastic Compositional Minimax Optimization with Provable Convergence Guarantees
Yuyang Deng, Fuli Qiao, Mehrdad Mahdavi
Stochastic compositional minimax problems are prevalent in machine learning, yet there are only limited established on the convergence of this class of problems. In this paper, we…