Batch Distillation Data for Developing Machine Learning Anomaly Detection Methods
arXiv:2510.18075 · doi:10.1038/s41597-026-07124-3
Abstract
Machine learning (ML) holds great potential to advance anomaly detection (AD) in chemical processes. However, the development of ML-based methods is hindered by the lack of openly available experimental data. To address this gap, we have set up a laboratory-scale batch distillation plant and operated it to generate an extensive experimental database, covering fault-free experiments and experiments in which anomalies were intentionally induced, for training advanced ML-based AD methods. In total, 119 experiments were conducted across a wide range of operating conditions and mixtures. Most experiments containing anomalies were paired with a corresponding fault-free one. The database that we provide here includes time-series data from numerous sensors and actuators, along with estimates of measurement uncertainty. In addition, unconventional data sources -- such as concentration profiles obtained via online benchtop NMR spectroscopy and video and audio recordings -- are provided. Extensive metadata and expert annotations of all experiments are included. The anomaly annotations are based on an ontology developed in this work. The data are organized in a structured database and made freely available via doi.org/10.5281/zenodo.17395543. This new database paves the way for the development of advanced ML-based AD methods. As it includes information on the causes of anomalies, it further enables the development of interpretable and explainable ML approaches, as well as methods for anomaly mitigation.
References in corpus (10)
- Deep Learning for Time Series Anomaly Detection: A Survey
- SOSA: A Lightweight Ontology for Sensors, Observations, Samples, and Actuators
- Anomaly Detection for a Water Treatment System Using Unsupervised Machine Learning
- Machine Learning in Thermodynamics: Prediction of Activity Coefficients by Matrix Completion
- HANNA: Hard-constraint Neural Network for Consistent Activity Coefficient Prediction
- Variational Inference for On-line Anomaly Detection in High-Dimensional Time Series
- Advancing Thermodynamic Group-Contribution Methods by Machine Learning: UNIFAC 2.0
- Modified UNIFAC 2.0 -- A Group-Contribution Method Completed with Machine Learning
- GRAPPA -- A Hybrid Graph Neural Network for Predicting Pure Component Vapor Pressures
- KnowTD-An Actionable Knowledge Representation System for Thermodynamics