Deep Context-Aware Novelty Detection

Abstract

A common assumption of novelty detection is that the distribution of both "normal" and "novel" data are static. This, however, is often not the case - for example scenarios where data evolves over time or scenarios in which the definition of normal and novel depends on contextual information, both leading to changes in these distributions. This can lead to significant difficulties when attempting to train a model on datasets where the distribution of normal data in one scenario is similar to that of novel data in another scenario. In this paper we propose a context-aware approach to novelty detection for deep autoencoders to address these difficulties. We create a semi-supervised network architecture that utilises auxiliary labels to reveal contextual information and allow the model to adapt to a variety of contexts in which the definitions of normal and novel change. We evaluate our approach on both image data and real world audio data displaying these characteristics and show that the performance of individually trained models can be achieved in a single model.

References in corpus (12)

• Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks
• Prototypical Networks for Few-shot Learning
• WaveNet: A Generative Model for Raw Audio
• A Learned Representation For Artistic Style
• Deep Anomaly Detection Using Geometric Transformations
• Modulating early visual processing by language
• FiLM: Visual Reasoning with a General Conditioning Layer
• Generative Probabilistic Novelty Detection with Adversarial Autoencoders
• MIMII Dataset: Sound Dataset for Malfunctioning Industrial Machine Investigation and Inspection
• Learning in an Uncertain World: Representing Ambiguity Through Multiple Hypotheses
• Generative Class-conditional Autoencoders
• Unsupervised Contextual Anomaly Detection using Joint Deep Variational Generative Models