Learning Concept Hierarchies from Text Corpora using Formal Concept Analysis

Abstract

We present a novel approach to the automatic acquisition of taxonomies or concept hierarchies from a text corpus. The approach is based on Formal Concept Analysis (FCA), a method mainly used for the analysis of data, i.e. for investigating and processing explicitly given information. We follow Harris distributional hypothesis and model the context of a certain term as a vector representing syntactic dependencies which are automatically acquired from the text corpus with a linguistic parser. On the basis of this context information, FCA produces a lattice that we convert into a special kind of partial order constituting a concept hierarchy. The approach is evaluated by comparing the resulting concept hierarchies with hand-crafted taxonomies for two domains: tourism and finance. We also directly compare our approach with hierarchical agglomerative clustering as well as with Bi-Section-KMeans as an instance of a divisive clustering algorithm. Furthermore, we investigate the impact of using different measures weighting the contribution of each attribute as well as of applying a particular smoothing technique to cope with data sparseness.

Cited by in corpus (22)

• SimLex-999: Evaluating Semantic Models with (Genuine) Similarity Estimation
• Introduction to Formal Concept Analysis and Its Applications in Information Retrieval and Related Fields
• Assessing Semantic Annotation Activities with Formal Concept Analysis
• Exact Learning of Lightweight Description Logic Ontologies
• COS960: A Chinese Word Similarity Dataset of 960 Word Pairs
• Completing and Debugging Ontologies: state of the art and challenges
• Forecasting of Events by Tweet Data Mining
• Coupling semantic and statistical techniques for dynamically enriching web ontologies
• Evaluating the Complementarity of Taxonomic Relation Extraction Methods Across Different Languages
• Artificial Intelligence Algorithms for Natural Language Processing and the Semantic Web Ontology Learning
• Automatic Ontology Learning from Domain-Specific Short Unstructured Text Data
• Learning Taxonomy for Text Segmentation by Formal Concept Analysis
• Formal Ontology Learning from English IS-A Sentences
• DLOLIS-A: Description Logic based Text Ontology Learning
• The nested Chinese restaurant process and Bayesian nonparametric inference of topic hierarchies
• Constructing Reference Sets from Unstructured, Ungrammatical Text
• TiFi: Taxonomy Induction for Fictional Domains [Extended version]
• Identifying Metaphor Hierarchies in a Corpus Analysis of Finance Articles
• BitSim: An Algebraic Similarity Measure for Description Logics Concepts
• Constructing Folksonomies from User-specified Relations on Flickr
• Principal component analysis for high-dimensional compositional data
• Formal Ontology Learning on Factual IS-A Corpus in English using Description Logics