Machine Teaching: A New Paradigm for Building Machine Learning Systems

Abstract

The current processes for building machine learning systems require practitioners with deep knowledge of machine learning. This significantly limits the number of machine learning systems that can be created and has led to a mismatch between the demand for machine learning systems and the ability for organizations to build them. We believe that in order to meet this growing demand for machine learning systems we must significantly increase the number of individuals that can teach machines. We postulate that we can achieve this goal by making the process of teaching machines easy, fast and above all, universally accessible. While machine learning focuses on creating new algorithms and improving the accuracy of "learners", the machine teaching discipline focuses on the efficacy of the "teachers". Machine teaching as a discipline is a paradigm shift that follows and extends principles of software engineering and programming languages. We put a strong emphasis on the teacher and the teacher's interaction with data, as well as crucial components such as techniques and design principles of interaction and visualization. In this paper, we present our position regarding the discipline of machine teaching and articulate fundamental machine teaching principles. We also describe how, by decoupling knowledge about machine learning algorithms from the process of teaching, we can accelerate innovation and empower millions of new uses for machine learning models.

Also available at: http://aka.ms/machineteachingpaper

Cited by in corpus (20)

• explAIner: A Visual Analytics Framework for Interactive and Explainable Machine Learning
• SOLOIST: Building Task Bots at Scale with Transfer Learning and Machine Teaching
• Software Engineering for AI-Based Systems: A Survey
• Lessons Learned from Designing an AI-Enabled Diagnosis Tool for Pathologists
• Facilitating Knowledge Sharing from Domain Experts to Data Scientists for Building NLP Models
• A Survey on Deep Learning Toolkits and Libraries for Intelligent User Interfaces
• DoWhy: Addressing Challenges in Expressing and Validating Causal Assumptions
• A Survey on Interactive Reinforcement Learning: Design Principles and Open Challenges
• Explainable Active Learning (XAL): An Empirical Study of How Local Explanations Impact Annotator Experience
• Enabling Collaborative Data Science Development with the Ballet Framework
• Conversation Learner -- A Machine Teaching Tool for Building Dialog Managers for Task-Oriented Dialog Systems
• Machine Teaching by Domain Experts: Towards More Humane,Inclusive, and Intelligent Machine Learning Systems
• Human-AI Co-Learning for Data-Driven AI
• A Work-Centered Approach for Cyber-Physical-Social System Design: Applications in Aerospace Industrial Inspection
• Learning the Designer's Preferences to Drive Evolution
• The future of human-AI collaboration: a taxonomy of design knowledge for hybrid intelligence systems
• Accelerating Entrepreneurial Decision-Making Through Hybrid Intelligence
• Model Rectification via Unknown Unknowns Extraction from Deployment Samples
• A Neural-Symbolic Framework for Mental Simulation
• Towards Teachable Conversational Agents