1.3k citations · 3.7k across the 43 of their papers we have counts for
11 papers · 1 filter
pair2vec: Compositional Word-Pair Embeddings for Cross-Sentence Inference
Mandar Joshi, Eunsol Choi, Omer Levy +2
Reasoning about implied relationships (e.g., paraphrastic, common sense, encyclopedic) between pairs of words is crucial for many cross-sentence inference problems. This paper prop…
code2seq: Generating Sequences from Structured Representations of Code
Uri Alon, Shaked Brody, Omer Levy +1
The ability to generate natural language sequences from source code snippets has a variety of applications such as code summarization, documentation, and retrieval. Sequence-to-seq…
Ultra-Fine Entity Typing
Eunsol Choi, Omer Levy, Yejin Choi +1
We introduce a new entity typing task: given a sentence with an entity mention, the goal is to predict a set of free-form phrases (e.g. skyscraper, songwriter, or criminal) that de…
Deep RNNs Encode Soft Hierarchical Syntax
Terra Blevins, Omer Levy, Luke Zettlemoyer
We present a set of experiments to demonstrate that deep recurrent neural networks (RNNs) learn internal representations that capture soft hierarchical notions of syntax from highl…
Long Short-Term Memory as a Dynamically Computed Element-wise Weighted Sum
Omer Levy, Kenton Lee, Nicholas FitzGerald +1
LSTMs were introduced to combat vanishing gradients in simple RNNs by augmenting them with gated additive recurrent connections. We present an alternative view to explain the succe…
LSTMs Exploit Linguistic Attributes of Data
Nelson F. Liu, Omer Levy, Roy Schwartz +2
While recurrent neural networks have found success in a variety of natural language processing applications, they are general models of sequential data. We investigate how the prop…