Circuit Fine-Tuning for Compute-Efficient Transformer Adaptation

Uri Z. Kialy, Gil Ben-Artzi

Parameter-Efficient Fine-Tuning (PEFT) has become the de facto standard for adapting Vision Transformers (ViTs) to downstream tasks. While parameter count has been the dominant eff…