Softmax is $1/2$-Lipschitz: A tight bound across all ${\ell }_p$ norms

Pravin Nair

The softmax function is a basic operator in machine learning and optimization, used in classification, attention mechanisms, reinforcement learning, game theory, and problems invol…