Preferential Mixture-of-Experts: Interpretable Models that Rely on Human Expertise as much as Possible

Abstract

We propose Preferential MoE, a novel human-ML mixture-of-experts model that augments human expertise in decision making with a data-based classifier only when necessary for predictive performance. Our model exhibits an interpretable gating function that provides information on when human rules should be followed or avoided. The gating function is maximized for using human-based rules, and classification errors are minimized. We propose solving a coupled multi-objective problem with convex subproblems. We develop approximate algorithms and study their performance and convergence. Finally, we demonstrate the utility of Preferential MoE on two clinical applications for the treatment of Human Immunodeficiency Virus (HIV) and management of Major Depressive Disorder (MDD).

arXiv comment10 pages, 5 figures, 4 tables, AMIA 2021 Virtual Informatics Summit

References in corpus (6)

• Parallel and Distributed Methods for Nonconvex Optimization--Part II: Applications
• Harnessing Deep Neural Networks with Logic Rules
• The Algorithmic Automation Problem: Prediction, Triage, and Human Effort
• Predict Responsibly: Improving Fairness and Accuracy by Learning to Defer
• Machine Learning with Abstention for Automated Liver Disease Diagnosis
• Consistent Estimators for Learning to Defer to an Expert