MiCA Learns More Knowledge Than LoRA and Full Fine-Tuning

Sten Rüdiger, Sebastian Raschka

Minor Component Adaptation (MiCA) is a novel parameter-efficient fine-tuning method for large language models that focuses on adapting underutilized subspaces of model representati…