Neural Networks as Local-to-Global Computations

Vicente Bosca, Robert Ghrist

We construct a cellular sheaf from any feedforward ReLU neural network by placing one vertex for each intermediate quantity in the forward pass and encoding each computational step…