Showing 2025Show all
2 papers · 1 filter
cs.LG2025
Automatic Rank Determination for Low-Rank Adaptation via Submodular Function Maximization
Yihang Gao, Vincent Y. F. Tan
In this paper, we propose SubLoRA, a rank determination method for Low-Rank Adaptation (LoRA) based on submodular function maximization. In contrast to prior approaches, such as Ad…
cs.LG2025
Low Tensor-Rank Adaptation of Kolmogorov--Arnold Networks
Yihang Gao, Michael K. Ng, Vincent Y. F. Tan
Kolmogorov--Arnold networks (KANs) have demonstrated their potential as an alternative to multi-layer perceptions (MLPs) in various domains, especially for science-related tasks. H…