Universal approximation property of ODENet and ResNet with a single activation function

Masato Kimura, Kazunori Matsui, Yosuke Mizuno

We study a universal approximation property of ODENet and ResNet. The ODENet is a map from an initial value to the final value of an ODE system in a finite interval. It is consider…