Showing cs.LGShow all
2 papers · 1 filter
cs.LG2025
MoKA: Mixture of Kronecker Adapters
Mohammadreza Sadeghi, Mahsa Ghazvini Nejad, MirHamed Jafarzadeh Asl +4
Parameter-efficient fine-tuning (PEFT) is essential for reducing the computational overhead of large language models (LLMs). Low-rank family adapters are commonly used to control t…
cs.LG2024
Towards Differentiable Multilevel Optimization: A Gradient-Based Approach
Yuntian Gu, Xuzheng Chen
Multilevel optimization has gained renewed interest in machine learning due to its promise in applications such as hyperparameter tuning and continual learning. However, existing m…