SliceFine: The Universal Winning-Slice Hypothesis for Pretrained Networks

Md Kowsher, Ali O. Polat, Ehsan Mohammady Ardehaly +4

This paper presents a theoretical framework explaining why fine tuning small, randomly selected subnetworks (slices) within pre trained models can be sufficient for downstream adap…