Recent Advances in Deep Learning: An Overview

Abstract

Deep Learning is one of the newest trends in Machine Learning and Artificial Intelligence research. It is also one of the most popular scientific research trends now-a-days. Deep learning methods have brought revolutionary advances in computer vision and machine learning. Every now and then, new and new deep learning techniques are being born, outperforming state-of-the-art machine learning and even existing deep learning techniques. In recent years, the world has seen many major breakthroughs in this field. Since deep learning is evolving at a huge speed, its kind of hard to keep track of the regular advances especially for new researchers. In this paper, we are going to briefly discuss about recent advances in Deep Learning for past few years.

arXiv comment31 pages including bibliography

References in corpus (44)

• Very Deep Convolutional Networks for Large-Scale Image Recognition
• Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
• Distilling the Knowledge in a Neural Network
• MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications
• TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems
• Show, Attend and Tell: Neural Image Caption Generation with Visual Attention
• LSTM: A Search Space Odyssey
• SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <0.5MB model size
• Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation
• Two-Stream Convolutional Networks for Action Recognition in Videos
• WaveNet: A Generative Model for Raw Audio
• Teaching Machines to Read and Comprehend
• Convolutional Sequence to Sequence Learning
• Deep Speech 2: End-to-End Speech Recognition in English and Mandarin
• Deep Generative Image Models using a Laplacian Pyramid of Adversarial Networks
• Tutorial on Variational Autoencoders
• Improved Techniques for Training GANs
• Recent Trends in Deep Learning Based Natural Language Processing
• Exploring the Limits of Language Modeling
• Visualizing and Understanding Recurrent Networks
• Dynamic Memory Networks for Visual and Textual Question Answering
• Resnet in Resnet: Generalizing Residual Architectures
• FractalNet: Ultra-Deep Neural Networks without Residuals
• Texture Networks: Feed-forward Synthesis of Textures and Stylized Images
• Deep Reinforcement Learning: An Overview
• Layer Normalization
• A Convolutional Neural Network for Modelling Sentences
• Deformable Convolutional Networks
• Deep Learning: A Critical Appraisal
• Neural GPUs Learn Algorithms
• Stacked Attention Networks for Image Question Answering
• Generative Visual Manipulation on the Natural Image Manifold
• Deep Learning of Representations: Looking Forward
• DeepMath - Deep Sequence Models for Premise Selection
• On the Origin of Deep Learning
• Neural Programmer: Inducing Latent Programs with Gradient Descent
• Deep Learning for Environmentally Robust Speech Recognition: An Overview of Recent Developments
• Fast Image Scanning with Deep Max-Pooling Convolutional Neural Networks
• Honk: A PyTorch Reimplementation of Convolutional Neural Networks for Keyword Spotting
• Highway Long Short-Term Memory RNNs for Distant Speech Recognition
• ChainerCV: a Library for Deep Learning in Computer Vision
• A Fast Learning Algorithm for Image Segmentation with Max-Pooling Convolutional Networks
• Convolutional Residual Memory Networks
• Generating Neural Networks with Neural Networks

Cited by in corpus (6)

• Early Melanoma Diagnosis with Sequential Dermoscopic Images
• Identifying extra high frequency gravitational waves generated from oscillons with cuspy potentials using deep neural networks
• Hessian based analysis of SGD for Deep Nets: Dynamics and Generalization
• Student Network Learning via Evolutionary Knowledge Distillation
• Reducing false positives in strong lens detection through effective augmentation and ensemble learning
• A novel DL approach to PE malware detection: exploring Glove vectorization, MCC_RCNN and feature fusion