Efficient Topic Model Estimation under Heavy-Tailed Document Lengths

Daniel Cirkovic, Tiandong Wang

Early inquiries into the statistical properties of natural language found that words tend to occur with power-law frequencies. This observation, closely associated with Zipf's law,…