The Evolution of the Interplay Between Input Distributions and Linear Regions in Networks

Xuan Qi, Yi Wei

It is commonly recognized that the expressiveness of deep neural networks is contingent upon a range of factors, encompassing their depth, width, and other relevant considerations.…