Five Architectures, One Shared Space Cross-Model Representational Alignment Without Weight Merging

Oladimeji Anthonio, Dimeji Olawuyi, Oloruntoba Ajayi +1

Combining language models is usually done by averaging weights, which works only when the models share a common starting point. We ask whether five frozen, independently trained mo…