Locally Weighted Naive Bayes

Abstract

Despite its simplicity, the naive Bayes classifier has surprised machine learning researchers by exhibiting good performance on a variety of learning problems. Encouraged by these results, researchers have looked to overcome naive Bayes primary weakness - attribute independence - and improve the performance of the algorithm. This paper presents a locally weighted version of naive Bayes that relaxes the independence assumption by learning local models at prediction time. Experimental results show that locally weighted naive Bayes rarely degrades accuracy compared to standard naive Bayes and, in many cases, improves accuracy dramatically. The main advantage of this method compared to other techniques for enhancing naive Bayes is its conceptual and computational simplicity.

Appears in Proceedings of the Nineteenth Conference on Uncertainty in Artificial Intelligence (UAI2003)

Cited by in corpus (9)

• Hyperparameter Optimization for Effort Estimation
• Transfer-Learning Oriented Class Imbalance Learning for Cross-Project Defect Prediction
• Evaluating Classifiers in Detecting 419 Scams in Bilingual Cybercriminal Communities
• Boosting the Discriminant Power of Naive Bayes
• Multi-label classification search space in the MEKA software
• Why Software Effort Estimation Needs SBSE
• Local Probabilistic Model for Bayesian Classification: a Generalized Local Classification Model
• Locally Weighted Learning for Naive Bayes Classifier
• Towards Teachable Conversational Agents