Amortized Neural Networks for Low-Latency Speech Recognition

Jonathan Macoskey, Grant P. Strimel, Jinru Su +1

We introduce Amortized Neural Networks (AmNets), a compute cost- and latency-aware network architecture particularly well-suited for sequence modeling tasks. We apply AmNets to the…