Extracting information from free text through unsupervised graph-based clustering: an application to patient incident records

Abstract

The large volume of text in electronic healthcare records often remains underused due to a lack of methodologies to extract interpretable content. Here we present an unsupervised framework for the analysis of free text that combines text-embedding with paragraph vectors and graph-theoretical multiscale community detection. We analyse text from a corpus of patient incident reports from the National Health Service in England to find content-based clusters of reports in an unsupervised manner and at different levels of resolution. Our unsupervised method extracts groups with high intrinsic textual consistency and compares well against categories hand-coded by healthcare personnel. We also show how to use our content-driven clusters to improve the supervised prediction of the degree of harm of the incident based on the text of the report. Finally, we discuss future directions to monitor reports over time, and to detect emerging trends outside pre-existing categories.

arXiv commentTo appear as a book chapter

References in corpus (9)

• Efficient Estimation of Word Representations in Vector Space
• A tool for filtering information in complex systems
• The map equation
• Markov dynamics as a zooming lens for multiscale community detection: non clique-like communities and the field-of-view limit
• Encoding dynamics for multiscale community detection: Markov time sweeping for the Map equation
• The stability of a graph partition: A dynamics-based framework for community detection
• From Free Text to Clusters of Content in Health Records: An Unsupervised Graph Partitioning Approach
• Semantic Word Clouds with Background Corpus Normalization and t-distributed Stochastic Neighbor Embedding
• Content-driven, unsupervised clustering of news articles through multiscale graph partitioning