Sobolev acceleration for neural networks

Jong Kwon Oh, Hanbaek Lyu, Hwijae Son

Sobolev training, which integrates target derivatives into the loss functions, has been shown to accelerate convergence and improve generalization compared to conventional $L^2$ tr…