Reducing the Adaptation Gap Through Reachable Fisher Geometry

Wasif Jalal, Sachin Deb, Asif Salekin

Parameter-efficient fine-tuning (PEFT) determines not only how many parameters are trained, but also which local directions a model can move in, so similar adapters can affect subg…