Minimum width for universal approximation using ReLU networks on compact domain

Namjun Kim, Chanho Min, Sejun Park

It has been shown that deep neural networks of a large enough width are universal approximators but they are not if the width is too small. There were several attempts to character…