Machine Learning in Automated Text Categorization
arXiv:cs/0110053 · doi:10.1145/505282.505283
Abstract
The automated categorization (or classification) of texts into predefined categories has witnessed a booming interest in the last ten years, due to the increased availability of documents in digital form and the ensuing need to organize them. In the research community the dominant approach to this problem is based on machine learning techniques: a general inductive process automatically builds a classifier by learning, from a set of preclassified documents, the characteristics of the categories. The advantages of this approach over the knowledge engineering approach (consisting in the manual definition of a classifier by domain experts) are a very good effectiveness, considerable savings in terms of expert manpower, and straightforward portability to different domains. This survey discusses the main approaches to text categorization that fall within the machine learning paradigm. We will discuss in detail issues pertaining to three different problems, namely document representation, classifier construction, and classifier evaluation.
Accepted for publication on ACM Computing Surveys
References in corpus (5)
Cited by in corpus (202)
- From Frequency to Meaning: Vector Space Models of Semantics
- Text Classification Algorithms: A Survey
- Finding Deceptive Opinion Spam by Any Stretch of the Imagination
- An evaluation of Naive Bayesian anti-spam filtering
- A Brief Survey of Text Mining: Classification, Clustering and Extraction Techniques
- HDLTex: Hierarchical Deep Learning for Text Classification
- Multi-Instance Multi-Label Learning
- Security Evaluation of Pattern Classifiers under Attack
- Web Data Extraction, Applications and Techniques: A Survey
- Wikipedia-based Semantic Interpretation for Natural Language Processing
- Adversarial Feature Selection against Evasion Attacks
- Toward Optimal Feature Selection in Naive Bayes for Text Categorization
- An Analysis of Hierarchical Text Classification Using Word Embeddings
- Utilizing Neural Networks and Linguistic Metadata for Early Detection of Depression Indications in Text Sequences
- Collective emotions online and their influence on community life
- Shallow and Deep Networks Intrusion Detection System: A Taxonomy and Survey
- TweepFake: about Detecting Deepfake Tweets
- Clinical Concept Extraction: a Methodology Review
- Sentiment Polarity Detection for Software Development
- CLAUDETTE: an Automated Detector of Potentially Unfair Clauses in Online Terms of Service
- A General End-to-end Diagnosis Framework for Manufacturing Systems
- Stacking classifiers for anti-spam filtering of e-mail
- Data-Driven Stochastic Robust Optimization: A General Computational Framework and Algorithm for Optimization under Uncertainty in the Big Data Era
- RMDL: Random Multimodel Deep Learning for Classification
- A Machine Learning Approach For Opinion Holder Extraction In Arabic Language
- Using network science and text analytics to produce surveys in a scientific topic
- When Machine Learning Meets Privacy: A Survey and Outlook
- Artificial Neural Networks-Based Machine Learning for Wireless Networks: A Tutorial
- Inference and Evaluation of the Multinomial Mixture Model for Text Clustering
- Complexity-entropy causality plane: a useful approach for distinguishing songs
- A Benchmark Study on Sentiment Analysis for Software Engineering Research
- Classifying informative and imaginative prose using complex networks
- Autonomy and Reliability of Continuous Active Learning for Technology-Assisted Review
- A Case Study of Spanish Text Transformations for Twitter Sentiment Analysis
- Can We Use SE-specific Sentiment Analysis Tools in a Cross-Platform Setting?
- Introducing Hann windows for reducing edge-effects in patch-based image segmentation
- tax2vec: Constructing Interpretable Features from Taxonomies for Short Text Classification
- The "Shut the f**k up" Phenomenon: Characterizing Incivility in Open Source Code Review Discussions
- Comparing SVM and Naive Bayes classifiers for text categorization with Wikitology as knowledge enrichment
- Computational linguistics and Natural Language Processing
- Exposing Paid Opinion Manipulation Trolls
- The relationship between linguistic expression and symptoms of depression, anxiety, and suicidal thoughts: A longitudinal study of blog content
- Quantitative Analysis of Bloggers Collective Behavior Powered by Emotions
- Text Data Mining: Theory and Methods
- Eprints and the Open Archives Initiative
- The Ivory Tower Lost: How College Students Respond Differently than the General Public to the COVID-19 Pandemic
- An Improvement of Data Classification Using Random Multimodel Deep Learning (RMDL)
- Identifying Banking Transaction Descriptions via Support Vector Machine Short-Text Classification Based on a Specialized Labelled Corpus
- Solutions to Detect and Analyze Online Radicalization : A Survey
- Automatic Metadata Generation using Associative Networks
- Applying machine learning to the problem of choosing a heuristic to select the variable ordering for cylindrical algebraic decomposition
- A Comparative Study on Different Types of Approaches to Bengali document Categorization
- A Novel Term_Class Relevance Measure for Text Categorization
- Adaptively Detecting Malicious Queries in Web Attacks
- Interface agents: A review of the field
- Modeling Order in Neural Word Embeddings at Scale
- Open Evaluation Tool for Layout Analysis of Document Images
- Topic2Vec: Learning Distributed Representations of Topics
- ArguLens: Anatomy of Community Opinions On Usability Issues Using Argumentation Models
- Cause Identification from Aviation Safety Incident Reports via Weakly Supervised Semantic Lexicon Construction
- Efficient Classification of Multi-Labelled Text Streams by Clashing
- Structural block driven - enhanced convolutional neural representation for relation extraction
- Which Clustering Do You Want? Inducing Your Ideal Clustering with Minimal Feedback
- A Comparative Study of Machine Learning Methods for Verbal Autopsy Text Classification
- Text Classification Using Association Rules, Dependency Pruning and Hyperonymization
- Inverse-Category-Frequency based supervised term weighting scheme for text categorization
- Using Machine Learning to Improve Cylindrical Algebraic Decomposition
- #MeTooMaastricht: Building a chatbot to assist survivors of sexual harassment
- Large Language Models for Healthcare Text Classification: A Systematic Review
- Arabic Text Categorization Algorithm using Vector Evaluation Method
- A Survey on Cost Types, Interaction Schemes, and Annotator Performance Models in Selection Algorithms for Active Learning in Classification
- Word Vector Enrichment of Low Frequency Words in the Bag-of-Words Model for Short Text Multi-class Classification Problems
- Reconstructing dynamical networks via feature ranking
- Towards a Job Title Classification System
- Text Classification For Authorship Attribution Analysis
- Enhancing the LexVec Distributed Word Representation Model Using Positional Contexts and External Memory
- Text classification based on ensemble extreme learning machine
- Influence Functions in Deep Learning Are Fragile
- Content-based Text Categorization using Wikitology
- Classification of Sets using Restricted Boltzmann Machines
- Text Classification: A Sequential Reading Approach
- Machine Learning in Artificial Intelligence: Towards a Common Understanding
- Dandelion: Redesigning the Bitcoin Network for Anonymity
- Classification and Clustering of arXiv Documents, Sections, and Abstracts, Comparing Encodings of Natural and Mathematical Language
- A Collaborative Filtering-Based Two Stage Model with Item Dependency for Course Recommendation
- Scaling associative classification for very large datasets
- On Security and Sparsity of Linear Classifiers for Adversarial Settings
- Twitter Hash Tag Recommendation
- Entropy-growth-based model of emotionally charged online dialogues
- A Practical Guide for the Effective Evaluation of Twitter User Geolocation
- Modeling Creativity: Case Studies in Python
- Re-evaluating Word Mover's Distance
- Identifying emergency stages in Facebook posts of police departments with convolutional and recurrent neural networks and support vector machines
- Visualization and clustering by 3D cellular automata: Application to unstructured data
- Statistical analysis of emotions and opinions at Digg website
- Large Scale Legal Text Classification Using Transformer Models
- On Second-Order Group Influence Functions for Black-Box Predictions
- On Horizontal and Vertical Separation in Hierarchical Text Classification
- Customized Routing Optimization Based on Gradient Boost Regressor Model
- Ontology-supported processing of clinical text using medical knowledge integration for multi-label classification of diagnosis coding
- Supervised learning Methods for Bangla Web Document Categorization
- Automatically Annotated Turkish Corpus for Named Entity Recognition and Text Categorization using Large-Scale Gazetteers
- Semi-supervised Text Categorization Using Recursive K-means Clustering
- Assessing the Use of AutoML for Data-Driven Software Engineering
- Optical neural network architecture for deep learning with the temporal synthetic dimension
- Text Classification of the Precursory Accelerating Seismicity Corpus: Inference on some Theoretical Trends in Earthquake Predictability Research from 1988 to 2018
- Rationale in Development Chat Messages: An Exploratory Study
- Utility-Theoretic Ranking for Semi-Automated Text Classification
- TF-IDFC-RF: A Novel Supervised Term Weighting Scheme
- MAT: A simple yet strong baseline for identifying self-admitted technical debt
- A Suffix Tree Approach to Email Filtering
- On Detecting Messaging Abuse in Short Text Messages using Linguistic and Behavioral patterns
- A Comparative Study of Hybrid Models in Health Misinformation Text Classification
- Fast Multi-Instance Multi-Label Learning
- Learning Representation Mapping for Relation Detection in Knowledge Base Question Answering
- Dynamic time warping distance for message propagation classification in Twitter
- A Multimodal Approach towards Emotion Recognition of Music using Audio and Lyrical Content
- Determining Leishmania Infection Levels by Automatic Analysis of Microscopy Images
- Natural language processing for word sense disambiguation and information extraction
- Optimising Rule-Based Classification in Temporal Data
- A Comparative Analysis of Distributional Term Representations for Author Profiling in Social Media
- verBERT: Automating Brazilian Case Law Document Multi-label Categorization Using BERT
- Ensemble Quantile Classifier
- Achieving Real-Time LiDAR 3D Object Detection on a Mobile Device
- Weighted Naive Bayes Model for Semi-Structured Document Categorization
- A comparison of several AI techniques for authorship attribution on Romanian texts
- A Survey on Web Multimedia Mining
- An Automatic Text Classification Method Based on Hierarchical Taxonomies, Neural Networks and Document Embedding: The NETHIC Tool
- A Joint Probabilistic Classification Model of Relevant and Irrelevant Sentences in Mathematical Word Problems
- Sapiens Chain: A Blockchain-based Cybersecurity Framework
- Sentiment Analysis in Twitter for Macedonian
- Leveraging web resources for keyword assignment to short text documents
- An Empirical Study of Sections in Classifying Disease Outbreak Reports
- Detecting Vietnamese Opinion Spam
- Unsupervised Morphological Expansion of Small Datasets for Improving Word Embeddings
- Analysis of Location Data Leakage in the Internet Traffic of Android-based Mobile Devices
- Cluster Based Symbolic Representation for Skewed Text Categorization
- On the Linear Algebraic Structure of Distributed Word Representations
- Modified SMOTE Using Mutual Information and Different Sorts of Entropies
- Supervised Term Weighting Metrics for Sentiment Analysis in Short Text
- Efficient 2-Step Protocol and Its Discriminative Feature Selections in Secure Similar Document Detection
- Reverse Transfer Learning: Can Word Embeddings Trained for Different NLP Tasks Improve Neural Language Models?
- Identifying Documents In-Scope of a Collection from Web Archives
- On the selection of the correct number of terms for profile construction: theoretical and empirical analysis
- Emotional Analysis of Blogs and Forums Data
- Impact of Feature Selection on Micro-Text Classification
- FSMJ: Feature Selection with Maximum Jensen-Shannon Divergence for Text Categorization
- An energy-based comparative analysis of common approaches to text classification in the Legal domain
- Online Model Evaluation in a Large-Scale Computational Advertising Platform
- Finite size induces crossover temperature in growing spin chains
- Identifier Namespaces in Mathematical Notation
- A Transformer-based Autoregressive Decoder Architecture for Hierarchical Text Classification
- Generating Cyber Threat Intelligence to Discover Potential Security Threats Using Classification and Topic Modeling
- Classifying the Unstructured IT Service Desk Tickets Using Ensemble of Classifiers
- Genetic Optimization of Keywords Subset in the Classification Analysis of Texts Authorship
- Semantic Representation and Inference for NLP
- Spatial Transformer Point Convolution
- Image-based Natural Language Understanding Using 2D Convolutional Neural Networks
- Classifying Vietnamese Disease Outbreak Reports with Important Sentences and Rich Features
- Discovering topics with neural topic models built from PLSA assumptions
- A Multilingual Encoding Method for Text Classification and Dialect Identification Using Convolutional Neural Network
- Email Classification into Relevant Category Using Neural Networks
- The FACTS of Technology-Assisted Sensitivity Review
- JaTeCS an open-source JAva TExt Categorization System
- A Search/Crawl Framework for Automatically Acquiring Scientific Documents
- Corpus analysis without prior linguistic knowledge - unsupervised mining of phrases and subphrase structure
- Generalized Ambiguity Decomposition for Understanding Ensemble Diversity
- Text Categorization via Similarity Search: An Efficient and Effective Novel Algorithm
- Improving Persian Document Classification Using Semantic Relations between Words
- A Route Confidence Evaluation Method for Reliable Hierarchical Text Categorization
- A Biomimetic Approach Based on Immune Systems for Classification of Unstructured Data
- State of the Art, Evaluation and Recommendations regarding "Document Processing and Visualization Techniques"
- Learning Only from Relevant Keywords and Unlabeled Documents
- Term-Class-Max-Support (TCMS): A Simple Text Document Categorization Approach Using Term-Class Relevance Measure
- Probabilistic Modeling of Progressive Filtering
- Link Graph Analysis for Adult Images Classification
- Diagnosis and Analysis of Celiac Disease and Environmental Enteropathy on Biopsy Images using Deep Learning Approaches
- CEAI: CCM based Email Authorship Identification Model
- Economic Reality, Economic Media and Individuals' Expectations
- Semantic Sort: A Supervised Approach to Personalized Semantic Relatedness
- Distributed classifier based on genetically engineered bacterial cell cultures
- Word Embeddings: Stability and Semantic Change
- Scale-free Characteristics of Multilingual Legal Texts and the Limitations of LLMs
- Feature Selection Based on Term Frequency and T-Test for Text Categorization
- Self-organizing Pattern in Multilayer Network for Words and Syllables
- Term-Weighting Learning via Genetic Programming for Text Classification
- A Model for Personalized Keyword Extraction from Web Pages using Segmentation
- Transfer Learning-Based Label Proportions Method with Data of Uncertainty
- A probabilistic methodology for multilabel classification
- Training-Based Equivalence Relations in Large-Scale Quantized Communication Systems
- A Statistical Approach Towards Robust Progress Estimation
- Classification of Pedagogical content using conventional machine learning and deep learning model
- Exploiting Deep Learning for Secure Transmission in an Underlay Cognitive Radio Network
- TF-CR: Weighting Embeddings for Text Classification
- Evolutionary algorithm based adaptive navigation in information retrieval interfaces
- Towards Math-Aware Automated Classification and Similarity Search of Scientific Publications: Methods of Mathematical Content Representations
- Comparison of Machine Learning Models to Classify Documents on Digital Development
- Whats in a Country Name - Twitter Hashtag Analysis of #singapore
- Categorical Metadata Representation for Customized Text Classification
- Coupled Representation Learning for Domains, Intents and Slots in Spoken Language Understanding
- Kategorisasi dokumen web secara otomatis berdasarkan folksonomy menggunakan multinomial naive Bayes classifier
- Content-Based Quality Estimation for Automatic Subject Indexing of Short Texts under Precision and Recall Constraints