3 citations · 4 across the 7 of their papers we have counts for
Showing cs.LGShow all
3 papers · 1 filter
cs.LG2025
The Resurrection of the ReLU
Coşku Can Horuz, Geoffrey Kasenbacher, Saya Higuchi +7
Modeling sophisticated activation functions within deep learning architectures has evolved into a distinct research direction. Functions such as GELU, SELU, and SiLU offer smooth g…
cs.LG2024
Flexible and Efficient Surrogate Gradient Modeling with Forward Gradient Injection
Sebastian Otte
Automatic differentiation is a key feature of present deep learning frameworks. Moreover, they typically provide various ways to specify custom gradients within the computation gra…
cs.LG2024
Representation Learning of Multivariate Time Series using Attention and Adversarial Training
Leon Scharwächter, Sebastian Otte
A critical factor in trustworthy machine learning is to develop robust representations of the training data. Only under this guarantee methods are legitimate to artificially genera…