2 papers
cs.LG2025
Continual Gradient Low-Rank Projection Fine-Tuning for LLMs
Chenxu Wang, Yilin Lyu, Zicheng Sun +1
Continual fine-tuning of Large Language Models (LLMs) is hampered by the trade-off between efficiency and expressiveness. Low-Rank Adaptation (LoRA) offers efficiency but constrain…
stat.ML2024
Nonstationary Sparse Spectral Permanental Process
Zicheng Sun, Yixuan Zhang, Zenan Ling +2
Existing permanental processes often impose constraints on kernel types or stationarity, limiting the model's expressiveness. To overcome these limitations, we propose a novel appr…