Sobolev Approximation by Fixed-Size Neural Networks with Arbitrary Accuracy

Baicheng Li, Haizhao Yang, Shijun Zhang

In this work, we investigate new activation functions for achieving arbitrary-accuracy Sobolev approximation by fixed-size neural networks. We first show that any function in $W^{2…