8 citations · 9 across the 3 of their papers we have counts for
5 papers
Towards Automatic Generation of Shareable Synthetic Clinical Notes Using Neural Language Models
Oren Melamud, Chaitanya Shivade
Large-scale clinical data is invaluable to driving many computational scientific advances today. However, understandable concerns regarding patient privacy hinder the open dissemin…
Self-Normalization Properties of Language Modeling
Jacob Goldberger, Oren Melamud
Self-normalizing discriminative models approximate the normalized probability of a class without having to compute the partition function. In the context of language modeling, this…
A Simple Language Model based on PMI Matrix Approximations
Oren Melamud, Ido Dagan, Jacob Goldberger
In this study, we introduce a new approach for learning language models by training them to estimate word-context pointwise mutual information (PMI), and then deriving the desired…
PMI Matrix Approximations with Applications to Neural Language Modeling
Oren Melamud, Ido Dagan, Jacob Goldberger
The negative sampling (NEG) objective function, used in word2vec, is a simplification of the Noise Contrastive Estimation (NCE) method. NEG was found to be highly effective in lear…
The Role of Context Types and Dimensionality in Learning Word Embeddings
Oren Melamud, David McClosky, Siddharth Patwardhan +1
We provide the first extensive evaluation of how using different types of context to learn skip-gram word embeddings affects performance on a wide range of intrinsic and extrinsic…