29 citations · 150 across the 35 of their papers we have counts for
3 papers · 1 filter
Why does CTC result in peaky behavior?
Albert Zeyer, Ralf Schlüter, Hermann Ney
The peaky behavior of CTC models is well known experimentally. However, an understanding about why peaky behavior occurs is missing, and whether this is a good property. We provide…
Successfully Applying the Stabilized Lottery Ticket Hypothesis to the Transformer Architecture
Christopher Brix, Parnia Bahar, Hermann Ney
Sparse models require less memory for storage and enable a faster inference by reducing the necessary number of FLOPs. This is relevant both for time-critical and on-device computa…
A comprehensive study of batch construction strategies for recurrent neural networks in MXNet
Patrick Doetsch, Pavel Golik, Hermann Ney
In this work we compare different batch construction methods for mini-batch training of recurrent neural networks. While popular implementations like TensorFlow and MXNet suggest a…