The Analysis of Data from Continuous Probability Distributions

Abstract

Conventional statistics begins with a model, and assigns a likelihood of obtaining any particular set of data. The opposite approach, beginning with the data and assigning a likelihood to any particular model, is explored here for the case of points drawn randomly from a continuous probability distribution. A scalar field theory is used to assign a likelihood over the space of probability distributions. The most likely distribution may be calculated, providing an estimate of the underlying distribution and a convenient graphical representation of the raw data. Fluctuations around this maximum likelihood estimate are characterized by a robust measure of goodness-of-fit. Its distribution may be calculated by integrating over fluctuations. The resulting method of data analysis has some advantages over conventional approaches.

8 pages, 2 figures, REVTeX

Cited by in corpus (7)

• Self-consistent method for density estimation
• Occam factors and model-independent Bayesian learning of continuous distributions
• Rapid and deterministic estimation of probability densities using scale-free field theories
• Unification of field theory and maximum entropy methods for learning probability densities
• Information theory and learning: a physical approach
• Predictability, complexity and learning
• Fluctuation-dissipation theorem and models of learning