247 citations · 907 across the 14 of their papers we have counts for
5 papers · 1 filter
Hierarchical Multiscale Recurrent Neural Networks
Junyoung Chung, Sungjin Ahn, Yoshua Bengio
Learning both hierarchical and temporal representation has been among the long-standing challenges of recurrent neural networks. Multiscale recurrent neural networks have been cons…
A Neural Knowledge Language Model
Sungjin Ahn, Heeyoul Choi, Tanel Pärnamaa +1
Current language models have a significant limitation in the ability to encode and decode factual knowledge. This is mainly because they acquire such knowledge from statistical co-…
Hierarchical Memory Networks
Sarath Chandar, Sungjin Ahn, Hugo Larochelle +3
Memory networks are neural networks with an explicit memory component that can be both read and written to by the network. The memory is often addressed in a soft way using a softm…
Pointing the Unknown Words
Caglar Gulcehre, Sungjin Ahn, Ramesh Nallapati +2
The problem of rare and unknown words is an important issue that can potentially influence the performance of many NLP systems, including both the traditional count-based and the d…
Generating Factoid Questions With Recurrent Neural Networks: The 30M Factoid Question-Answer Corpus
Iulian Vlad Serban, Alberto García-Durán, Caglar Gulcehre +4
Over the past decade, large-scale supervised learning corpora have enabled machine learning researchers to make substantial advances. However, to this date, there are no large-scal…