ReLU Deep Neural Networks from the Hierarchical Basis Perspective

Juncai He, Lin Li, Jinchao Xu

We study ReLU deep neural networks (DNNs) by investigating their connections with the hierarchical basis method in finite element methods. First, we show that the approximation sch…