2 papers
cs.CL2025
Block Circulant Adapter for Large Language Models
Xinyu Ding, Meiqi Wang, Siyu Liao +1
Fine-tuning large language models (LLMs) is difficult due to their huge model size. Recent Fourier domain-based methods show potential for reducing fine-tuning costs. We propose a…
cs.LG2025
Parameter-Efficient Fine-Tuning with Circulant and Diagonal Vectors
Xinyu Ding, Lexuan Chen, Siyu Liao +1
Foundation models have achieved tremendous success in different domains. However, their huge computation and storage complexity make these models difficult to fine-tune and also le…