3 papers
cs.CL2019
Towards Automatic Generation of Shareable Synthetic Clinical Notes Using Neural Language Models
Oren Melamud, Chaitanya Shivade
Large-scale clinical data is invaluable to driving many computational scientific advances today. However, understandable concerns regarding patient privacy hinder the open dissemin…
cs.CL2018
Self-Normalization Properties of Language Modeling
Jacob Goldberger, Oren Melamud
Self-normalizing discriminative models approximate the normalized probability of a class without having to compute the partition function. In the context of language modeling, this…
cs.CL2017
A Simple Language Model based on PMI Matrix Approximations
Oren Melamud, Ido Dagan, Jacob Goldberger
In this study, we introduce a new approach for learning language models by training them to estimate word-context pointwise mutual information (PMI), and then deriving the desired…