A Label Attention Model for ICD Coding from Clinical Text

Abstract

ICD coding is a process of assigning the International Classification of Disease diagnosis codes to clinical/medical notes documented by health professionals (e.g. clinicians). This process requires significant human resources, and thus is costly and prone to error. To handle the problem, machine learning has been utilized for automatic ICD coding. Previous state-of-the-art models were based on convolutional neural networks, using a single/several fixed window sizes. However, the lengths and interdependence between text fragments related to ICD codes in clinical text vary significantly, leading to the difficulty of deciding what the best window sizes are. In this paper, we propose a new label attention model for automatic ICD coding, which can handle both the various lengths and the interdependence of the ICD code related text fragments. Furthermore, as the majority of ICD codes are not frequently used, leading to the extremely imbalanced data issue, we additionally propose a hierarchical joint learning mechanism extending our label attention model to handle the issue, using the hierarchical relationships among the codes. Our label attention model achieves new state-of-the-art results on three benchmark MIMIC datasets, and the joint learning mechanism helps improve the performances for infrequent codes.

In Proceedings of IJCAI 2020 (Main Track)

References in corpus (6)

• Adam: A Method for Stochastic Optimization
• PyTorch: An Imperative Style, High-Performance Deep Learning Library
• Decoupled Weight Decay Regularization
• Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translation
• A Structured Self-attentive Sentence Embedding
• Generalized Zero-shot ICD Coding

Cited by in corpus (12)

• Automated Medical Coding on MIMIC-III and MIMIC-IV: A Critical Review and Replicability Study
• Hierarchical Label-wise Attention Transformer Model for Explainable ICD Coding
• De-identification is not enough: a comparison between de-identified and synthetic clinical notes
• Automated Coding of Under-Studied Medical Concept Domains: Linking Physical Activity Reports to the International Classification of Functioning, Disability, and Health
• Read, Attend, and Code: Pushing the Limits of Medical Codes Prediction from Clinical Notes by Machines
• A Systematic Literature Review of Automated ICD Coding and Classification Systems using Discharge Summaries
• Multitask Balanced and Recalibrated Network for Medical Code Prediction
• From Extreme Multi-label to Multi-class: A Hierarchical Approach for Automated ICD-10 Coding Using Phrase-level Attention
• A Meta-embedding-based Ensemble Approach for ICD Coding Prediction
• GrabQC: Graph based Query Contextualization for automated ICD coding
• Description-based Label Attention Classifier for Explainable ICD-9 Classification
• Modeling Diagnostic Label Correlation for Automatic ICD Coding