A Frank System for Co-Evolutionary Hybrid Decision-Making

Abstract

We introduce Frank, a human-in-the-loop system for co-evolutionary hybrid decision-making aiding the user to label records from an un-labeled dataset. Frank employs incremental learning to ``evolve'' in parallel with the user's decisions, by training an interpretable machine learning model on the records labeled by the user. Furthermore, Frank advances state-of-the-art approaches by offering inconsistency controls, explanations, fairness checks, and bad-faith safeguards simultaneously. We evaluate our proposal by simulating the users' behavior with various levels of expertise and reliance on Frank's suggestions. The experiments show that Frank's intervention leads to improvements in the accuracy and the fairness of the decisions.

13 pages

References in corpus (4)

• A continual learning survey: Defying forgetting in classification tasks
• Aleatoric and Epistemic Uncertainty in Machine Learning: An Introduction to Concepts and Methods
• A Comprehensive Survey of Continual Learning: Theory, Method and Application
• Learning in the Wild with Incremental Skeptical Gaussian Processes