Connecting Independently Trained Modes via Layer-Wise Connectivity

Yongding Tian, Zaid Al-Ars, Maksim Kitsak +1

Empirical studies have shown that continuous low-loss paths can be constructed between independently trained neural network models. This phenomenon, known as mode connectivity, ref…