Graceful Degradation and Related Fields

Abstract

When machine learning models encounter data which is out of the distribution on which they were trained they have a tendency to behave poorly, most prominently over-confidence in erroneous predictions. Such behaviours will have disastrous effects on real-world machine learning systems. In this field graceful degradation refers to the optimisation of model performance as it encounters this out-of-distribution data. This work presents a definition and discussion of graceful degradation and where it can be applied in deployed visual systems. Following this a survey of relevant areas is undertaken, novelly splitting the graceful degradation problem into active and passive approaches. In passive approaches, graceful degradation is handled and achieved by the model in a self-contained manner, in active approaches the model is updated upon encountering epistemic uncertainties. This work communicates the importance of the problem and aims to prompt the development of machine learning strategies that are aware of graceful degradation.

References in corpus (12)

• Mastering Chess and Shogi by Self-Play with a General Reinforcement Learning Algorithm
• Domain Separation Networks
• Three scenarios for continual learning
• Unsupervised Domain Adaptation through Self-Supervision
• Beyond temperature scaling: Obtaining well-calibrated multiclass probabilities with Dirichlet calibration
• Continual Learning of a Mixed Sequence of Similar and Dissimilar Tasks
• Contrastive Training for Improved Out-of-Distribution Detection
• Why is the Mahalanobis Distance Effective for Anomaly Detection?
• Bayesian Generative Active Deep Learning
• Heuristic Domain Adaptation
• Active Learning with Multiple Kernels
• Novel Uncertainty Framework for Deep Learning Ensembles