Estimating the number of classes
arXiv:0708.2153 · doi:10.1214/009053606000001280
Abstract
Estimating the unknown number of classes in a population has numerous important applications. In a Poisson mixture model, the problem is reduced to estimating the odds that a class is undetected in a sample. The discontinuity of the odds prevents the existence of locally unbiased and informative estimators and restricts confidence intervals to be one-sided. Confidence intervals for the number of classes are also necessarily one-sided. A sequence of lower bounds to the odds is developed and used to define pseudo maximum likelihood estimators for the number of classes.
Published at http://dx.doi.org/10.1214/009053606000001280 in the Annals of Statistics (http://www.imstat.org/aos/) by the Institute of Mathematical Statistics (http://www.imstat.org)
Cited by in corpus (11)
- Extrapolation of Urn Models via Poissonization: Accurate Measurements of the Microbial Unknown
- Chebyshev polynomials, moment matching, and optimal estimation of the unseen
- HPDedup: A Hybrid Prioritized Data Deduplication Mechanism for Primary Storage in the Cloud
- Non-Bayesian Parametric Missing-Mass Estimation
- Data Amplification: Instance-Optimal Property Estimation
- Moment-based Bayesian Poisson Mixtures for inferring unobserved units
- Inference for changes in biodiversity
- The Broad Optimality of Profile Maximum Likelihood
- Better lower bounds for missing species: improved non-parametric moment-based estimation for large experiments
- Nonparametric species richness estimation under convexity constraint
- Estimating Diversity via Frequency Ratios