Showing cs.LGShow all
3 papers · 1 filter
cs.LG2025
Aliasing in Convnets: A Frame-Theoretic Perspective
Daniel Haider, Vincent Lostanlen, Martin Ehler +2
Using a stride in a convolutional layer inherently introduces aliasing, which has implications for numerical stability and statistical generalization. While techniques such as the…
cs.LG2024
Injectivity of ReLU-layers: Tools from Frame Theory
Daniel Haider, Martin Ehler, Peter Balazs
Injectivity is the defining property of a mapping that ensures no information is lost and any input can be perfectly reconstructed from its output. By performing hard thresholding,…
cs.LG2024
(Almost) Smooth Sailing: Towards Numerical Stability of Neural Networks Through Differentiable Regularization of the Condition Number
Rossen Nenov, Daniel Haider, Peter Balazs
Maintaining numerical stability in machine learning models is crucial for their reliability and performance. One approach to maintain stability of a network layer is to integrate t…