Parameter-Efficient Fine-Tuning with Circulant and Diagonal Vectors

Xinyu Ding, Lexuan Chen, Siyu Liao +1

Foundation models have achieved tremendous success in different domains. However, their huge computation and storage complexity make these models difficult to fine-tune and also le…