Linear Interpolation In Parameter Space is Good Enough for Fine-Tuned Language Models

Mark Rofin, Nikita Balagansky, Daniil Gavrilov

The simplest way to obtain continuous interpolation between two points in high dimensional space is to draw a line between them. While previous works focused on the general connect…