activity
20202026
most citedDistributed Inference and Fine-tuning of Large Language Models Over The Internet

14 citations · 20 across the 4 of their papers we have counts for

collaborators
Showing 2020Show all

1 paper · 1 filter

cs.LG2020

Weight Squeezing: Reparameterization for Knowledge Transfer and Model Compression

Artem Chumachenko, Daniil Gavrilov, Nikita Balagansky +1

In this work, we present a novel approach for simultaneous knowledge transfer and model compression called Weight Squeezing. With this method, we perform knowledge transfer from a…