Fitting A Mixture Distribution to Data: Tutorial

Abstract

This paper is a step-by-step tutorial for fitting a mixture distribution to data. It merely assumes the reader has the background of calculus and linear algebra. Other required background is briefly reviewed before explaining the main algorithm. In explaining the main algorithm, first, fitting a mixture of two distributions is detailed and examples of fitting two Gaussians and Poissons, respectively for continuous and discrete cases, are introduced. Thereafter, fitting several distributions in general case is explained and examples of several Gaussians (Gaussian Mixture Model) and Poissons are again provided. Model-based clustering, as one of the applications of mixture distributions, is also introduced. Numerical simulations are also provided for both Gaussian and Poisson examples for the sake of better clarification.

arXiv comment12 pages, 9 figures, 1 table. Some typos are corrected in this version

Cited by in corpus (5)

• Linear and Quadratic Discriminant Analysis: Tutorial
• Locally Linear Embedding and its Variants: Tutorial and Survey
• Sampling Algorithms, from Survey Sampling to Monte Carlo Methods: Tutorial and Literature Review
• Factor Analysis, Probabilistic Principal Component Analysis, Variational Inference, and Variational Autoencoder: Tutorial and Survey
• Generative Adversarial Networks and Adversarial Autoencoders: Tutorial and Survey