3 papers
cmp-lg1996
Building Probabilistic Models for Natural Language
Stanley F. Chen
In this thesis, we investigate three problems involving the probabilistic modeling of language: smoothing n-gram models, statistical grammar induction, and bilingual sentence align…
cmp-lg1996
An Empirical Study of Smoothing Techniques for Language Modeling
Stanley F. Chen, Joshua T. Goodman
We present an extensive empirical comparison of several smoothing techniques in the domain of language modeling, including those described by Jelinek and Mercer (1980), Katz (1987)…
cmp-lg1995
Bayesian Grammar Induction for Language Modeling
Stanley F. Chen
We describe a corpus-based induction algorithm for probabilistic context-free grammars. The algorithm employs a greedy heuristic search within a Bayesian framework, and a post-pass…