Convex Bounds on the Softmax Function with Applications to Robustness Verification

Dennis Wei, Haoze Wu, Min Wu +3

The softmax function is a ubiquitous component at the output of neural networks and increasingly in intermediate layers as well. This paper provides convex lower bounds and concave…