Comparative Experiments on Disambiguating Word Senses: An Illustration of the Role of Bias in Machine Learning

Abstract

This paper describes an experimental comparison of seven different learning algorithms on the problem of learning to disambiguate the meaning of a word from context. The algorithms tested include statistical, neural-network, decision-tree, rule-based, and case-based classification techniques. The specific problem tested involves disambiguating six senses of the word ``line'' using the words in the current and proceeding sentence as context. The statistical and neural-network methods perform the best on this particular problem and we discuss a potential reason for this observed difference. We also discuss the role of bias in machine learning and its importance in explaining performance differences observed on specific problems.

10 pages

Cited by in corpus (15)

• A Simple Approach to Building Ensembles of Naive Bayesian Classifiers for Word Sense Disambiguation
• Distinguishing Word Senses in Untagged Text
• On the Explainability of Natural Language Processing Deep Models
• Selective Sampling for Example-based Word Sense Disambiguation
• Word sense disambiguation: a complex network approach
• Exemplar-Based Word Sense Disambiguation: Some Recent Improvements
• Naive Bayes and Exemplar-Based approaches to Word Sense Disambiguation Revisited
• An Empirical Comparison of Probability Models for Dependency Grammar
• Sequential Model Selection for Word Sense Disambiguation
• Learning Probabilistic Models of Word Sense Disambiguation
• Learning Features that Predict Cue Usage
• Learning Parse and Translation Decisions From Examples With Rich Context
• A Comparative Study of the Application of Different Learning Techniques to Natural Language Interfaces
• Measure Twice, Cut Once: Quantifying Bias and Fairness in Deep Neural Networks
• A Decision Tree of Bigrams is an Accurate Predictor of Word Sense