Universal Approximation Properties for an ODENet and a ResNet: Mathematical Analysis and Numerical Experiments

Yuto Aizawa, Masato Kimura, Kazunori Matsui

We prove a universal approximation property (UAP) for a class of ODENet and a class of ResNet, which are simplified mathematical models for deep learning systems with skip connecti…