Some Best Practices in Operator Learning
arXiv:2412.06686
Abstract
Hyperparameters searches are computationally expensive. This paper studies some general choices of hyperparameters and training methods specifically for operator learning. It considers the architectures DeepONets, Fourier neural operators and Koopman autoencoders for several differential equations to find robust trends. Some options considered are activation functions, dropout and stochastic weight averaging.
arXiv admin note: substantial text overlap with arXiv:2412.04578