Hyperparameter Transfer in Graph Neural Networks

Gage DeZoort, Boris Hanin

The performance of deep learning models crucially depends on the settings of hyperparameters like learning rate, initialization scale, and weight decay. Hyperparameter transfer aim…