Machine Learning in Automated Text Categorization

Abstract

The automated categorization (or classification) of texts into predefined categories has witnessed a booming interest in the last ten years, due to the increased availability of documents in digital form and the ensuing need to organize them. In the research community the dominant approach to this problem is based on machine learning techniques: a general inductive process automatically builds a classifier by learning, from a set of preclassified documents, the characteristics of the categories. The advantages of this approach over the knowledge engineering approach (consisting in the manual definition of a classifier by domain experts) are a very good effectiveness, considerable savings in terms of expert manpower, and straightforward portability to different domains. This survey discusses the main approaches to text categorization that fall within the machine learning paradigm. We will discuss in detail issues pertaining to three different problems, namely document representation, classifier construction, and classifier evaluation.

Accepted for publication on ACM Computing Surveys

Cited by in corpus (201)

• From Frequency to Meaning: Vector Space Models of Semantics
• Text Classification Algorithms: A Survey
• Finding Deceptive Opinion Spam by Any Stretch of the Imagination
• A Brief Survey of Text Mining: Classification, Clustering and Extraction Techniques
• HDLTex: Hierarchical Deep Learning for Text Classification
• Multi-Instance Multi-Label Learning
• Security Evaluation of Pattern Classifiers under Attack
• Web Data Extraction, Applications and Techniques: A Survey
• Wikipedia-based Semantic Interpretation for Natural Language Processing
• Adversarial Feature Selection against Evasion Attacks
• Toward Optimal Feature Selection in Naive Bayes for Text Categorization
• An Analysis of Hierarchical Text Classification Using Word Embeddings
• Utilizing Neural Networks and Linguistic Metadata for Early Detection of Depression Indications in Text Sequences
• Collective emotions online and their influence on community life
• Shallow and Deep Networks Intrusion Detection System: A Taxonomy and Survey
• TweepFake: about Detecting Deepfake Tweets
• Clinical Concept Extraction: a Methodology Review
• Sentiment Polarity Detection for Software Development
• CLAUDETTE: an Automated Detector of Potentially Unfair Clauses in Online Terms of Service
• A General End-to-end Diagnosis Framework for Manufacturing Systems
• Stacking classifiers for anti-spam filtering of e-mail
• Data-Driven Stochastic Robust Optimization: A General Computational Framework and Algorithm for Optimization under Uncertainty in the Big Data Era
• RMDL: Random Multimodel Deep Learning for Classification
• A Machine Learning Approach For Opinion Holder Extraction In Arabic Language
• Using network science and text analytics to produce surveys in a scientific topic
• When Machine Learning Meets Privacy: A Survey and Outlook
• Artificial Neural Networks-Based Machine Learning for Wireless Networks: A Tutorial
• Inference and Evaluation of the Multinomial Mixture Model for Text Clustering
• Complexity-entropy causality plane: a useful approach for distinguishing songs
• A Benchmark Study on Sentiment Analysis for Software Engineering Research
• Classifying informative and imaginative prose using complex networks
• Autonomy and Reliability of Continuous Active Learning for Technology-Assisted Review
• A Case Study of Spanish Text Transformations for Twitter Sentiment Analysis
• Can We Use SE-specific Sentiment Analysis Tools in a Cross-Platform Setting?
• Introducing Hann windows for reducing edge-effects in patch-based image segmentation
• tax2vec: Constructing Interpretable Features from Taxonomies for Short Text Classification
• The "Shut the f**k up" Phenomenon: Characterizing Incivility in Open Source Code Review Discussions
• Comparing SVM and Naive Bayes classifiers for text categorization with Wikitology as knowledge enrichment
• Computational linguistics and Natural Language Processing
• Exposing Paid Opinion Manipulation Trolls
• The relationship between linguistic expression and symptoms of depression, anxiety, and suicidal thoughts: A longitudinal study of blog content
• Quantitative Analysis of Bloggers Collective Behavior Powered by Emotions
• Text Data Mining: Theory and Methods
• Eprints and the Open Archives Initiative
• The Ivory Tower Lost: How College Students Respond Differently than the General Public to the COVID-19 Pandemic
• Identifying Banking Transaction Descriptions via Support Vector Machine Short-Text Classification Based on a Specialized Labelled Corpus
• An Improvement of Data Classification Using Random Multimodel Deep Learning (RMDL)
• Solutions to Detect and Analyze Online Radicalization : A Survey
• Automatic Metadata Generation using Associative Networks
• A Comparative Study on Different Types of Approaches to Bengali document Categorization
• A Novel Term_Class Relevance Measure for Text Categorization
• Applying machine learning to the problem of choosing a heuristic to select the variable ordering for cylindrical algebraic decomposition
• Adaptively Detecting Malicious Queries in Web Attacks
• Interface agents: A review of the field
• Modeling Order in Neural Word Embeddings at Scale
• Topic2Vec: Learning Distributed Representations of Topics
• Open Evaluation Tool for Layout Analysis of Document Images
• ArguLens: Anatomy of Community Opinions On Usability Issues Using Argumentation Models
• Cause Identification from Aviation Safety Incident Reports via Weakly Supervised Semantic Lexicon Construction
• Efficient Classification of Multi-Labelled Text Streams by Clashing
• Structural block driven - enhanced convolutional neural representation for relation extraction
• Which Clustering Do You Want? Inducing Your Ideal Clustering with Minimal Feedback
• A Comparative Study of Machine Learning Methods for Verbal Autopsy Text Classification
• Text Classification Using Association Rules, Dependency Pruning and Hyperonymization
• Inverse-Category-Frequency based supervised term weighting scheme for text categorization
• #MeTooMaastricht: Building a chatbot to assist survivors of sexual harassment
• Using Machine Learning to Improve Cylindrical Algebraic Decomposition
• Large Language Models for Healthcare Text Classification: A Systematic Review
• Arabic Text Categorization Algorithm using Vector Evaluation Method
• A Survey on Cost Types, Interaction Schemes, and Annotator Performance Models in Selection Algorithms for Active Learning in Classification
• Word Vector Enrichment of Low Frequency Words in the Bag-of-Words Model for Short Text Multi-class Classification Problems
• Reconstructing dynamical networks via feature ranking
• Towards a Job Title Classification System
• Text Classification For Authorship Attribution Analysis
• Enhancing the LexVec Distributed Word Representation Model Using Positional Contexts and External Memory
• Text classification based on ensemble extreme learning machine
• Content-based Text Categorization using Wikitology
• Influence Functions in Deep Learning Are Fragile
• Text Classification: A Sequential Reading Approach
• Machine Learning in Artificial Intelligence: Towards a Common Understanding
• Classification of Sets using Restricted Boltzmann Machines
• Classification and Clustering of arXiv Documents, Sections, and Abstracts, Comparing Encodings of Natural and Mathematical Language
• Dandelion: Redesigning the Bitcoin Network for Anonymity
• Scaling associative classification for very large datasets
• A Collaborative Filtering-Based Two Stage Model with Item Dependency for Course Recommendation
• A Practical Guide for the Effective Evaluation of Twitter User Geolocation
• Twitter Hash Tag Recommendation
• On Security and Sparsity of Linear Classifiers for Adversarial Settings
• Entropy-growth-based model of emotionally charged online dialogues
• Modeling Creativity: Case Studies in Python
• Re-evaluating Word Mover's Distance
• Visualization and clustering by 3D cellular automata: Application to unstructured data
• Identifying emergency stages in Facebook posts of police departments with convolutional and recurrent neural networks and support vector machines
• Large Scale Legal Text Classification Using Transformer Models
• Statistical analysis of emotions and opinions at Digg website
• On Second-Order Group Influence Functions for Black-Box Predictions
• On Horizontal and Vertical Separation in Hierarchical Text Classification
• Customized Routing Optimization Based on Gradient Boost Regressor Model
• Ontology-supported processing of clinical text using medical knowledge integration for multi-label classification of diagnosis coding
• Supervised learning Methods for Bangla Web Document Categorization
• Automatically Annotated Turkish Corpus for Named Entity Recognition and Text Categorization using Large-Scale Gazetteers
• Semi-supervised Text Categorization Using Recursive K-means Clustering
• Assessing the Use of AutoML for Data-Driven Software Engineering
• Optical neural network architecture for deep learning with the temporal synthetic dimension
• Text Classification of the Precursory Accelerating Seismicity Corpus: Inference on some Theoretical Trends in Earthquake Predictability Research from 1988 to 2018
• Rationale in Development Chat Messages: An Exploratory Study
• Utility-Theoretic Ranking for Semi-Automated Text Classification
• TF-IDFC-RF: A Novel Supervised Term Weighting Scheme
• On Detecting Messaging Abuse in Short Text Messages using Linguistic and Behavioral patterns
• A Suffix Tree Approach to Email Filtering
• A Comparative Study of Hybrid Models in Health Misinformation Text Classification
• MAT: A simple yet strong baseline for identifying self-admitted technical debt
• Natural language processing for word sense disambiguation and information extraction
• Fast Multi-Instance Multi-Label Learning
• Learning Representation Mapping for Relation Detection in Knowledge Base Question Answering
• Dynamic time warping distance for message propagation classification in Twitter
• Determining Leishmania Infection Levels by Automatic Analysis of Microscopy Images
• A Multimodal Approach towards Emotion Recognition of Music using Audio and Lyrical Content
• Weighted Naive Bayes Model for Semi-Structured Document Categorization
• Achieving Real-Time LiDAR 3D Object Detection on a Mobile Device
• Ensemble Quantile Classifier
• Optimising Rule-Based Classification in Temporal Data
• A comparison of several AI techniques for authorship attribution on Romanian texts
• verBERT: Automating Brazilian Case Law Document Multi-label Categorization Using BERT
• A Comparative Analysis of Distributional Term Representations for Author Profiling in Social Media
• A Survey on Web Multimedia Mining
• A Joint Probabilistic Classification Model of Relevant and Irrelevant Sentences in Mathematical Word Problems
• An Automatic Text Classification Method Based on Hierarchical Taxonomies, Neural Networks and Document Embedding: The NETHIC Tool
• Sapiens Chain: A Blockchain-based Cybersecurity Framework
• Sentiment Analysis in Twitter for Macedonian
• An Empirical Study of Sections in Classifying Disease Outbreak Reports
• Supervised Term Weighting Metrics for Sentiment Analysis in Short Text
• Unsupervised Morphological Expansion of Small Datasets for Improving Word Embeddings
• Cluster Based Symbolic Representation for Skewed Text Categorization
• Analysis of Location Data Leakage in the Internet Traffic of Android-based Mobile Devices
• Leveraging web resources for keyword assignment to short text documents
• Modified SMOTE Using Mutual Information and Different Sorts of Entropies
• Detecting Vietnamese Opinion Spam
• On the Linear Algebraic Structure of Distributed Word Representations
• Efficient 2-Step Protocol and Its Discriminative Feature Selections in Secure Similar Document Detection
• Finite size induces crossover temperature in growing spin chains
• Identifying Documents In-Scope of a Collection from Web Archives
• On the selection of the correct number of terms for profile construction: theoretical and empirical analysis
• Reverse Transfer Learning: Can Word Embeddings Trained for Different NLP Tasks Improve Neural Language Models?
• Emotional Analysis of Blogs and Forums Data
• Impact of Feature Selection on Micro-Text Classification
• FSMJ: Feature Selection with Maximum Jensen-Shannon Divergence for Text Categorization
• An energy-based comparative analysis of common approaches to text classification in the Legal domain
• Online Model Evaluation in a Large-Scale Computational Advertising Platform
• Discovering topics with neural topic models built from PLSA assumptions
• A Transformer-based Autoregressive Decoder Architecture for Hierarchical Text Classification
• Generating Cyber Threat Intelligence to Discover Potential Security Threats Using Classification and Topic Modeling
• Classifying the Unstructured IT Service Desk Tickets Using Ensemble of Classifiers
• Genetic Optimization of Keywords Subset in the Classification Analysis of Texts Authorship
• Semantic Representation and Inference for NLP
• Spatial Transformer Point Convolution
• Image-based Natural Language Understanding Using 2D Convolutional Neural Networks
• Classifying Vietnamese Disease Outbreak Reports with Important Sentences and Rich Features
• A Biomimetic Approach Based on Immune Systems for Classification of Unstructured Data
• A Multilingual Encoding Method for Text Classification and Dialect Identification Using Convolutional Neural Network
• Email Classification into Relevant Category Using Neural Networks
• The FACTS of Technology-Assisted Sensitivity Review
• JaTeCS an open-source JAva TExt Categorization System
• A Search/Crawl Framework for Automatically Acquiring Scientific Documents
• Corpus analysis without prior linguistic knowledge - unsupervised mining of phrases and subphrase structure
• Identifier Namespaces in Mathematical Notation
• Generalized Ambiguity Decomposition for Understanding Ensemble Diversity
• Text Categorization via Similarity Search: An Efficient and Effective Novel Algorithm
• Improving Persian Document Classification Using Semantic Relations between Words
• A Route Confidence Evaluation Method for Reliable Hierarchical Text Categorization
• Content-Based Quality Estimation for Automatic Subject Indexing of Short Texts under Precision and Recall Constraints
• State of the Art, Evaluation and Recommendations regarding "Document Processing and Visualization Techniques"
• Term-Class-Max-Support (TCMS): A Simple Text Document Categorization Approach Using Term-Class Relevance Measure
• Probabilistic Modeling of Progressive Filtering
• Learning Only from Relevant Keywords and Unlabeled Documents
• Distributed classifier based on genetically engineered bacterial cell cultures
• Towards Math-Aware Automated Classification and Similarity Search of Scientific Publications: Methods of Mathematical Content Representations
• CEAI: CCM based Email Authorship Identification Model
• Link Graph Analysis for Adult Images Classification
• Semantic Sort: A Supervised Approach to Personalized Semantic Relatedness
• Term-Weighting Learning via Genetic Programming for Text Classification
• Economic Reality, Economic Media and Individuals' Expectations
• Comparison of Machine Learning Models to Classify Documents on Digital Development
• Feature Selection Based on Term Frequency and T-Test for Text Categorization
• Word Embeddings: Stability and Semantic Change
• Transfer Learning-Based Label Proportions Method with Data of Uncertainty
• A Model for Personalized Keyword Extraction from Web Pages using Segmentation
• Diagnosis and Analysis of Celiac Disease and Environmental Enteropathy on Biopsy Images using Deep Learning Approaches
• A probabilistic methodology for multilabel classification
• Self-organizing Pattern in Multilayer Network for Words and Syllables
• A Statistical Approach Towards Robust Progress Estimation
• Evolutionary algorithm based adaptive navigation in information retrieval interfaces
• Classification of Pedagogical content using conventional machine learning and deep learning model
• Exploiting Deep Learning for Secure Transmission in an Underlay Cognitive Radio Network
• TF-CR: Weighting Embeddings for Text Classification
• Training-Based Equivalence Relations in Large-Scale Quantized Communication Systems
• Whats in a Country Name - Twitter Hashtag Analysis of #singapore
• Scale-free Characteristics of Multilingual Legal Texts and the Limitations of LLMs
• Kategorisasi dokumen web secara otomatis berdasarkan folksonomy menggunakan multinomial naive Bayes classifier
• Categorical Metadata Representation for Customized Text Classification
• Coupled Representation Learning for Domains, Intents and Slots in Spoken Language Understanding