Layer-wise Linear Mode Connectivity

Linara Adilova, Maksym Andriushchenko, Michael Kamp +2

Averaging neural network parameters is an intuitive method for fusing the knowledge of two independent models. It is most prominently used in federated learning. If models are aver…