2 papers
cs.LG2025
The Space Between: On Folding, Symmetries and Sampling
Michal Lewandowski, Bernhard Heinzl, Raphael Pisoni +1
Recent findings suggest that consecutive layers of neural networks with the ReLU activation function \emph{fold} the input space during the learning process. While many works hint…
cs.LG2025
On Space Folds of ReLU Neural Networks
Michal Lewandowski, Hamid Eghbalzadeh, Bernhard Heinzl +2
Recent findings suggest that the consecutive layers of ReLU neural networks can be understood geometrically as space folding transformations of the input space, revealing patterns…