LSHTC: A Benchmark for Large-Scale Text Classification

Abstract

LSHTC is a series of challenges which aims to assess the performance of classification systems in large-scale classification in a a large number of classes (up to hundreds of thousands). This paper describes the dataset that have been released along the LSHTC series. The paper details the construction of the datsets and the design of the tracks as well as the evaluation measures that we implemented and a quick overview of the results. All of these datasets are available online and runs may still be submitted on the online server of the challenges.

Cited by in corpus (42)

• An Analysis of Hierarchical Text Classification Using Word Embeddings
• Hierarchical Text Classification with Reinforced Label Assignment
• Effectiveness of Hierarchical Softmax in Large Scale Classification Tasks
• DiSMEC - Distributed Sparse Machines for Extreme Multi-label Classification
• PECOS: Prediction for Enormous and Correlated Output Spaces
• Extreme Multi-Label Legal Text Classification: A case study in EU Legislation
• On Data Augmentation for Extreme Multi-label Classification
• Learning to Sample: Counting with Complex Queries
• TextBenDS: a generic Textual data Benchmark for Distributed Systems
• Taming Pretrained Transformers for Extreme Multi-label Text Classification
• An empirical study on large scale text classification with skip-gram embeddings
• Strategies and Principles of Distributed Machine Learning on Big Data
• Distributed Machine Learning via Sufficient Factor Broadcasting
• Distributed Optimization of Multi-Class SVMs
• Large Scale Legal Text Classification Using Transformer Models
• Hyperbolic Interaction Model For Hierarchical Multi-Label Classification
• Efficient Pairwise Learning Using Kernel Ridge Regression: an Exact Two-Step Method
• Unbiased scalable softmax optimization
• HiNet: Hierarchical Classification with Neural Network
• A hierarchical loss and its problems when classifying non-hierarchically
• GNN-XML: Graph Neural Networks for Extreme Multi-label Text Classification
• Latent Variable Modeling with Diversity-Inducing Mutual Angular Regularization
• Benchmarking Top-K Keyword and Top-K Document Processing with T${}^2$K${}^2$ and T${}^2$K${}^2$D${}^2$
• Multi-label Ranking: Mining Multi-label and Label Ranking Data
• DS-MLR: Exploiting Double Separability for Scaling up Distributed Multinomial Logistic Regression
• T${}^2$K${}^2$: The Twitter Top-K Keywords Benchmark
• Label Disentanglement in Partition-based Extreme Multilabel Classification
• TwistBytes -- Hierarchical Classification at GermEval 2019: walking the fine line (of recall and precision)
• Unbiased Loss Functions for Extreme Classification With Missing Labels
• Extreme Multi-label Classification from Aggregated Labels
• Creating Training Sets via Weak Indirect Supervision
• Improving Pretrained Models for Zero-shot Multi-label Text Classification through Reinforced Label Hierarchy Reasoning
• Efficient Primal-Dual Algorithms for Large-Scale Multiclass Classification
• PIANO: A Fast Parallel Iterative Algorithm for Multinomial and Sparse Multinomial Logistic Regression
• A Hierarchical Spectral Method for Extreme Classification
• e-Commerce product classification: our participation at cDiscount 2015 challenge
• Block-wise Partitioning for Extreme Multi-label Classification
• Taxonomy grounded aggregation of classifiers with different label sets
• Data-dependent Generalization Bounds for Multi-class Classification
• MATCH: Metadata-Aware Text Classification in A Large Hierarchy
• Binary Stochastic Representations for Large Multi-class Classification
• MEMOIR: Multi-class Extreme Classification with Inexact Margin