A Two-Stage Bayesian Semiparametric Model for Novelty Detection with Robust Prior Information

Abstract

Novelty detection methods aim at partitioning the test units into already observed and previously unseen patterns. However, two significant issues arise: there may be considerable interest in identifying specific structures within the novelty, and contamination in the known classes could completely blur the actual separation between manifest and new groups. Motivated by these problems, we propose a two-stage Bayesian semiparametric novelty detector, building upon prior information robustly extracted from a set of complete learning units. We devise a general-purpose multivariate methodology that we also extend to handle functional data objects. We provide insights on the model behavior by investigating the theoretical properties of the associated semiparametric prior. From the computational point of view, we propose a suitable $\mathbf{\xi }$-sequence to construct an independent slice-efficient sampler that takes into account the difference between manifest and novelty components. We showcase our model performance through an extensive simulation study and applications on both multivariate and functional datasets, in which diverse and distinctive unknown patterns are discovered.

References in corpus (14)

• Natural Scales in Geographical Patterns
• Variational Inference: A Review for Statisticians
• One-Class Classification: Taxonomy of Study and Review of Techniques
• Minimum Covariance Determinant and Extensions
• Model-based clustering based on sparse finite Gaussian mixtures
• Discussion on Bayesian Cluster Analysis: Point Estimation and Credible Balls by Sara Wade and Zoubin Ghahramani
• Bayesian cluster analysis: Point estimation and credible balls
• The Minimum Regularized Covariance Determinant estimator
• Variable selection and updating in model-based discriminant analysis for high dimensional data with food authenticity applications
• Central limit theorem and influence function for the MCD estimators at general multivariate distributions
• Functional clustering in nested designs: Modeling variability in reproductive epidemiology studies
• Anomaly and Novelty detection for robust semi-supervised learning
• Unobserved classes and extra variables in high-dimensional discriminant analysis
• An enriched mixture model for functional clustering