Kernel-estimated Nonparametric Overlap-Based Syncytial Clustering

Abstract

Commonly-used clustering algorithms usually find ellipsoidal, spherical or other regular-structured clusters, but are more challenged when the underlying groups lack formal structure or definition. Syncytial clustering is the name that we introduce for methods that merge groups obtained from standard clustering algorithms in order to reveal complex group structure in the data. Here, we develop a distribution-free fully-automated syncytial clustering algorithm that can be used with $k$-means and other algorithms. Our approach estimates the cumulative distribution function of the normed residuals from an appropriately fit $k$-groups model and calculates the estimated nonparametric overlap between each pair of clusters. Groups with high pairwise overlap are merged as long as the estimated generalized overlap decreases. Our methodology is always a top performer in identifying groups with regular and irregular structures in several datasets and can be applied to datasets with scatter or incomplete records. The approach is also used to identify the distinct kinds of gamma ray bursts in the Burst and Transient Source Experiment 4Br catalog and the distinct kinds of activation in a functional Magnetic Resonance Imaging study.

arXiv comment32 pages, 22 figures, 9 tables: published in JMLR at: http://jmlr.org/papers/v21/18-435.html

References in corpus (9)

• The Physics of Gamma-Ray Bursts
• Three types of gamma-ray bursts
• A Mixture of Generalized Hyperbolic Distributions
• Mixtures of Shifted Asymmetric Laplace Distributions
• A Re-defined and Generalized Percent-Overlap-of-Activation Measure for Studies of fMRI Reproducibility and its Use in Identifying Outlier Activation Maps
• Gaussian-Mixture-Model-based Cluster Analysis Finds Five Kinds of Gamma Ray Bursts in the BATSE Catalog
• Assessing Certainty of Activation or Inactivation in Test-Retest fMRI Studies
• Multivariate $t$-Mixtures-Model-based Cluster Analysis of BATSE Catalog Establishes Importance of All Observed Parameters, Confirms Five Distinct Ellipsoidal Sub-populations of Gamma Ray Bursts
• An efficient $k$-means-type algorithm for clustering datasets with incomplete records

Cited by in corpus (3)

• An Efficient $k$-modes Algorithm for Clustering Categorical Datasets
• Fast model-based clustering of partial records
• Skeleton Clustering: Dimension-Free Density-based Clustering