Hierarchical Clustering Based on Mutual Information

Abstract

Motivation: Clustering is a frequently used concept in variety of bioinformatical applications. We present a new method for hierarchical clustering of data called mutual information clustering (MIC) algorithm. It uses mutual information (MI) as a similarity measure and exploits its grouping property: The MI between three objects X, Y, and Z is equal to the sum of the MI between X and Y, plus the MI between Z and the combined object (XY). Results: We use this both in the Shannon (probabilistic) version of information theory, where the "objects" are probability distributions represented by random samples, and in the Kolmogorov (algorithmic) version, where the "objects" are symbol sequences. We apply our method to the construction of mammal phylogenetic trees from mitochondrial DNA sequences and we reconstruct the fetal ECG from the output of independent components analysis (ICA) applied to the ECG of a pregnant woman. Availability: The programs for estimation of MI and for clustering (probabilistic version) are available at http://www.fz-juelich.de/nic/cs/software

11 pages, 5 figures

References in corpus (2)

• Estimating Mutual Information
• The similarity metric

Cited by in corpus (14)

• Clustering by compression
• An econophysics approach to analyse uncertainty in financial markets: an application to the Portuguese stock market
• Sequence alignment, mutual information, and dissimilarity measures for constructing phylogenies
• DeepHist: Differentiable Joint and Color Histogram Layers for Image-to-Image Translation
• Multiscale mobility patterns and the restriction of human movement
• Entropy and Uncertainty Analysis in Financial Markets
• Info-Clustering: A Mathematical Theory for Data Clustering
• MIC: Mutual Information based hierarchical Clustering
• Metrics for Community Analysis: A Survey
• A Fast Quartet Tree Heuristic for Hierarchical Clustering
• Hue-Net: Intensity-based Image-to-Image Translation with Differentiable Histogram Loss Functions
• Application of distances between terms for flat and hierarchical data
• Abstract Representations and Frequent Pattern Discovery
• Normalized information-based divergences