4 papers
Aliasing in Convnets: A Frame-Theoretic Perspective
Daniel Haider, Vincent Lostanlen, Martin Ehler +2
Using a stride in a convolutional layer inherently introduces aliasing, which has implications for numerical stability and statistical generalization. While techniques such as the…
ISAC: An Invertible and Stable Auditory Filter Bank with Customizable Kernels for ML Integration
Daniel Haider, Felix Perfler, Peter Balazs +2
This paper introduces ISAC, an invertible and stable, perceptually-motivated filter bank that is specifically designed to be integrated into machine learning paradigms. More precis…
Optimal lower Lipschitz bounds for ReLU layers, saturation, and phase retrieval
Daniel Freeman, Daniel Haider
The injectivity of ReLU layers in neural networks, the recovery of vectors from clipped or saturated measurements, and (real) phase retrieval in allow for a similar…
Injectivity of ReLU-layers: Tools from Frame Theory
Daniel Haider, Martin Ehler, Peter Balazs
Injectivity is the defining property of a mapping that ensures no information is lost and any input can be perfectly reconstructed from its output. By performing hard thresholding,…