CoRA: Optimizing Low-Rank Adaptation with Common Subspace of Large Language Models

Xiaojun Xiao, Sen Shen, Qiming Bao +4

In fine-tuning large language models (LLMs), conserving computational resources while maintaining effectiveness and improving outcomes within the same computational constraints is…