Understanding LSTM -- a tutorial into Long Short-Term Memory Recurrent Neural Networks
arXiv:1909.09586
Abstract
Long Short-Term Memory Recurrent Neural Networks (LSTM-RNN) are one of the most powerful dynamic classifiers publicly known. The network itself and the related learning algorithms are reasonably well documented to get an idea how it works. This paper will shed more light into understanding how LSTM-RNNs evolved and why they work impressively well, focusing on the early, ground-breaking publications. We significantly improved documentation and fixed a number of errors and inconsistencies that accumulated in previous publications. To support understanding we as well revised and unified the notation used.
arXiv comment42 pages, 11 figures, tutorial
References in corpus (15)
- Sequence to Sequence Learning with Neural Networks
- Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling
- Show, Attend and Tell: Neural Image Caption Generation with Visual Attention
- Improving neural networks by preventing co-adaptation of feature detectors
- Recurrent Neural Network Regularization
- Attention-Based Models for Speech Recognition
- A Neural Conversational Model
- End-to-end Continuous Speech Recognition using Attention-based Recurrent NN: First Results
- Learning to Execute
- Listen, Attend and Spell
- Grid Long Short-Term Memory
- A Clockwork RNN
- Addressing the Rare Word Problem in Neural Machine Translation
- Multi-Dimensional Recurrent Neural Networks
- Phoneme recognition in TIMIT with BLSTM-CTC
Cited by in corpus (7)
- Microswimmers learning chemotaxis with genetic algorithms
- MalBERT: Using Transformers for Cybersecurity and Malicious Software Detection
- E-Quarantine: A Smart Health System for Monitoring Coronavirus Patients for Remotely Quarantine
- Sequential Random Network for Fine-grained Image Classification
- A Deep Deterministic Policy Gradient-based Strategy for Stocks Portfolio Management
- Artificial intelligence prediction of stock prices using social media
- DeepWORD: A GCN-based Approach for Owner-Member Relationship Detection in Autonomous Driving