Showing cs.LGShow all
2 papers · 1 filter
cs.LG2025
The Resurrection of the ReLU
CoÅku Can Horuz, Geoffrey Kasenbacher, Saya Higuchi +7
Modeling sophisticated activation functions within deep learning architectures has evolved into a distinct research direction. Functions such as GELU, SELU, and SiLU offer smooth g…
cs.LG2024
Rethinking generalization of classifiers in separable classes scenarios and over-parameterized regimes
Julius Martinetz, Christoph Linse, Thomas Martinetz
We investigate the learning dynamics of classifiers in scenarios where classes are separable or classifiers are over-parameterized. In both cases, Empirical Risk Minimization (ERM)…