5 papers
WeightCLIP: Aligning Datasets and Models for Weight Space Learning
Aron Asefaw, Konstantinos Tzevelekakis, Damian Falk +2
Weight space learning aims to learn representations of neural network (NN) weights, enabling different downstream tasks. Existing approaches show promising performance, but lacking…
Learning Model Representations Using Publicly Available Model Hubs
Damian Falk, Konstantin Schürholt, Konstantinos Tzevelekakis +2
The weights of neural networks have emerged as a novel data modality, giving rise to the field of weight space learning. A central challenge in this area is that learning meaningfu…
A Model Zoo on Phase Transitions in Neural Networks
Konstantin Schürholt, Léo Meynent, Yefan Zhou +3
Using the weights of trained Neural Network (NN) models as data modality has recently gained traction as a research field - dubbed Weight Space Learning (WSL). Multiple recent work…
A Model Zoo of Vision Transformers
Damian Falk, Léo Meynent, Florence Pfammatter +2
The availability of large, structured populations of neural networks - called 'model zoos' - has led to the development of a multitude of downstream tasks ranging from model analys…
Structure Is Not Enough: Leveraging Behavior for Neural Network Weight Reconstruction
Léo Meynent, Ivan Melev, Konstantin Schürholt +2
The weights of neural networks (NNs) have recently gained prominence as a new data modality in machine learning, with applications ranging from accuracy and hyperparameter predicti…