On Expressivity of Height in Neural Networks

Feng-Lei Fan, Ze-Yu Li, Huan Xiong +1

In this work, beyond width and depth, we augment a neural network with a new dimension called height by intra-linking neurons in the same layer to create an intra-layer hierarchy,…