Optimal lower Lipschitz bounds for ReLU layers, saturation, and phase retrieval

Daniel Freeman, Daniel Haider

The injectivity of ReLU layers in neural networks, the recovery of vectors from clipped or saturated measurements, and (real) phase retrieval in ${\mathbb{R}}^n$ allow for a similar…