Estimating Continuous Distributions in Bayesian Classifiers

Abstract

When modeling a probability distribution with a Bayesian network, we are faced with the problem of how to handle continuous variables. Most previous work has either solved the problem by discretizing, or assumed that the data are generated by a single Gaussian. In this paper we abandon the normality assumption and instead use statistical methods for nonparametric density estimation. For a naive Bayesian classifier, we present experimental results on a variety of natural and artificial domains, comparing two methods of density estimation: assuming normality and modeling each conditional distribution with a single Gaussian; and using nonparametric kernel density estimation. We observe large reductions in error on several natural and artificial data sets, which suggests that kernel estimation is a useful tool for learning Bayesian models.

Appears in Proceedings of the Eleventh Conference on Uncertainty in Artificial Intelligence (UAI1995)

Cited by in corpus (26)

• Structure-semantics interplay in complex networks and its effects on the predictability of similarity in texts
• Feature Extraction and Soft Computing Methods for Aerospace Structure Defect Classification
• Bayes and Naive Bayes Classifier
• Classification of signaling proteins based on molecular star graph descriptors using Machine Learning models
• Limiting the effects of earthquakes on gravitational-wave interferometers
• Negative Effects of Incentivised Viral Campaigns for Activity in Social Networks
• A Method for Group Extraction and Analysis in Multilayer Social Networks
• An Improved Naive Bayes Classifier-based Noise Detection Technique for Classifying User Phone Call Behavior
• Lifted Relational Variational Inference
• Application of Data Mining to Network Intrusion Detection: Classifier Selection Model
• Semi-supervised Classification for Natural Language Processing
• Exponential Series Approaches for Nonparametric Graphical Models
• Classifying textual data: shallow, deep and ensemble methods
• A Naive Bayes machine learning approach to risk prediction using censored, time-to-event data
• Detecting Vietnamese Opinion Spam
• Performance Analysis of Machine Learning Techniques to Predict Diabetes Mellitus
• Analyzing Social and Stylometric Features to Identify Spear phishing Emails
• Data Mining: A prediction Technique for the workers in the PR Department of Orissa (Block and Panchayat)
• Improving Change Prediction Models with Code Smell-Related Information
• ITCM: A Real Time Internet Traffic Classifier Monitor
• Predicting Group Evolution in the Social Network
• Detecting Spammers via Aggregated Historical Data Set
• A Feature-based Classification Technique for Answering Multi-choice World History Questions
• Supervised Learning for Optimal Power Flow as a Real-Time Proxy
• Fast Multi-Class Probabilistic Classifier by Sparse Non-parametric Density Estimation
• Local Probabilistic Model for Bayesian Classification: a Generalized Local Classification Model