1 citations · 1 across the 1 of their papers we have counts for
2 papers
cs.CL2022★ 1 cited
Linear Interpolation In Parameter Space is Good Enough for Fine-Tuned Language Models
Mark Rofin, Nikita Balagansky, Daniil Gavrilov
The simplest way to obtain continuous interpolation between two points in high dimensional space is to draw a line between them. While previous works focused on the general connect…
cs.LG2020
Weight Squeezing: Reparameterization for Knowledge Transfer and Model Compression
Artem Chumachenko, Daniil Gavrilov, Nikita Balagansky +1
In this work, we present a novel approach for simultaneous knowledge transfer and model compression called Weight Squeezing. With this method, we perform knowledge transfer from a…