Mode Combinability: Exploring Convex Combinations of Permutation Aligned Models

Adrián Csiszárik, Melinda F. Kiss, Péter Kőrösi-Szabó +3

We explore element-wise convex combinations of two permutation-aligned neural network parameter vectors ${\Theta }_A$ and ${\Theta }_B$ of size $d$. We conduct extensive experiments by examining v…