An Epistemic Approach to the Formal Specification of Statistical Machine Learning
arXiv:2004.12734 · doi:10.1007/s10270-020-00825-2
Abstract
We propose an epistemic approach to formalizing statistical properties of machine learning. Specifically, we introduce a formal model for supervised learning based on a Kripke model where each possible world corresponds to a possible dataset and modal operators are interpreted as transformation and testing on datasets. Then we formalize various notions of the classification performance, robustness, and fairness of statistical classifiers by using our extension of statistical epistemic logic (StatEL). In this formalization, we show relationships among properties of classifiers, and relevance between classification performance and robustness. As far as we know, this is the first work that uses epistemic models and logical formulas to express statistical properties of machine learning, and would be a starting point to develop theories of formal specification of machine learning.
arXiv commentAccepted in Software and Systems Modeling https://rdcu.be/b7ssR This paper is the journal version of the SEFM'19 conference paper arxiv:1907.10327
References in corpus (6)
- DeepXplore: Automated Whitebox Testing of Deep Learning Systems
- Fairness Beyond Disparate Treatment & Disparate Impact: Learning Classification without Disparate Mistreatment
- Fairness Testing: Testing Software for Discrimination
- Automated Directed Fairness Testing
- Towards Logical Specification of Statistical Machine Learning
- Statistical Epistemic Logic