Relu and softplus neural nets as zero-sum turn-based games

Stephane Gaubert, Yiannis Vlassopoulos

We show that the output of a ReLU neural network can be interpreted as the value of a zero-sum, turn-based, stopping game, which we call the ReLU net game. The game runs in the dir…