Recurrent Neural Networks (RNNs): A gentle Introduction and Overview

Abstract

State-of-the-art solutions in the areas of "Language Modelling & Generating Text", "Speech Recognition", "Generating Image Descriptions" or "Video Tagging" have been using Recurrent Neural Networks as the foundation for their approaches. Understanding the underlying concepts is therefore of tremendous importance if we want to keep up with recent or upcoming publications in those areas. In this work we give a short overview over some of the most important concepts in the realm of Recurrent Neural Networks which enables readers to easily understand the fundamentals such as but not limited to "Backpropagation through Time" or "Long Short-Term Memory Units" as well as some of the more recent advances like the "Attention Mechanism" or "Pointer Networks". We also give recommendations for further reading regarding more complex topics where it is necessary.

References in corpus (3)

• Sequence to Sequence Learning with Neural Networks
• Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation
• Gated Feedback Recurrent Neural Networks

Cited by in corpus (8)

• Vision-Language Models for Medical Report Generation and Visual Question Answering: A Review
• Hybrid quantum cycle generative adversarial network for small molecule generation
• Transfer Learning with Foundational Models for Time Series Forecasting using Low-Rank Adaptations
• Not Hydro: Using Neural Networks to estimate galaxy properties on a Dark-Matter-Only simulation
• Forecasting steam mass flow in power plants using the parallel hybrid network
• C-RADAR: A Centralized Deep Learning System for Intrusion Detection in Software Defined Networks
• A Survey of Classical And Quantum Sequence Models
• Explainability-aided Domain Generalization for Image Classification