activity
20172020
most citedOn the State of the Art of Evaluation in Neural Language Models

49 citations · 52 across the 2 of their papers we have counts for

collaborators

8 papers

cs.CL2020

Capturing document context inside sentence-level neural machine translation models with self-training

Elman Mansimov, Gábor Melis, Lei Yu

Neural machine translation (NMT) has arguably achieved human level parity when trained and evaluated at the sentence-level. Document-level neural machine translation has received l…

cs.CL2019

A Critical Analysis of Biased Parsers in Unsupervised Parsing

Chris Dyer, Gábor Melis, Phil Blunsom

A series of recent papers has used a parsing algorithm due to Shen et al. (2018) to recover phrase-structure trees based on proxies for "syntactic depth." These proxy depths are ob…

cs.CL2019

Unsupervised Recurrent Neural Network Grammars

Yoon Kim, Alexander M. Rush, Lei Yu +3

Recurrent neural network grammars (RNNG) are generative models of language which jointly model syntax and surface structure by incrementally generating a syntax tree and sentence i…

cs.CL20193 cited

Variational Smoothing in Recurrent Neural Network Language Models

Lingpeng Kong, Gabor Melis, Wang Ling +2

We present a new theoretical perspective of data noising in recurrent neural network language models (Xie et al., 2017). We show that each variant of data noising is an instance of…

cs.CL2018

Encoding Spatial Relations from Natural Language

Tiago Ramalho, Tomáš Kočiský, Frederic Besse +5

Natural language processing has made significant inroads into learning the semantics of words through distributional approaches, however representations learnt via these methods fa…

stat.ML2018

Pushing the bounds of dropout

Gábor Melis, Charles Blundell, Tomáš Kočiský +3

We show that dropout training is best understood as performing MAP estimation concurrently for a family of conditional models whose objectives are themselves lower bounded by the o…