61 citations · 358 across the 40 of their papers we have counts for
3 papers · 1 filter
Transferable Graph Metanetworks
Yuxin Ma, Adir Dayan, Yam Eitan +2
A weight space network (or metanetwork) takes the weights of another neural network as input and predicts properties of it. Most prior work trains such models on input networks of…
Warm-starting PDE solvers with any-dimensional machine learning
Wilson G. Gregory, George A. Kevrekidis, Ben Blum-Smith +1
Any-dimensional machine learning models, such as graph neural networks (GNNs), can be naturally trained and evaluated on inputs of different sizes and dimensions. Inspired by the G…
pscaling small models: Principled warm starts and hyperparameter transfer
Yuxin Ma, Nan Chen, Mateo Díaz +3
Modern large-scale neural networks are often trained and released in multiple sizes to accommodate diverse inference budgets. To improve efficiency, recent work has explored model…