176 citations · 826 across the 63 of their papers we have counts for
Showing 2023Show all
2 papers · 1 filter
cs.LG2023★ 17 cited
Recurrent Neural Networks and Long Short-Term Memory Networks: Tutorial and Survey
Benyamin Ghojogh, Ali Ghodsi
This is a tutorial paper on Recurrent Neural Network (RNN), Long Short-Term Memory Network (LSTM), and their variants. We start with a dynamical system and backpropagation through…
cs.LG2023
Improved knowledge distillation by utilizing backward pass knowledge in neural networks
Aref Jafari, Mehdi Rezagholizadeh, Ali Ghodsi
Knowledge distillation (KD) is one of the prominent techniques for model compression. In this method, the knowledge of a large network (teacher) is distilled into a model (student)…