Pushing on Text Readability Assessment: A Transformer Meets Handcrafted Linguistic Features
arXiv:2109.12258
Abstract
We report two essential improvements in readability assessment: 1. three novel features in advanced semantics and 2. the timely evidence that traditional ML models (e.g. Random Forest, using handcrafted features) can combine with transformers (e.g. RoBERTa) to augment model performance. First, we explore suitable transformers and traditional ML models. Then, we extract 255 handcrafted linguistic features using self-developed extraction software. Finally, we assemble those to create several hybrid models, achieving state-of-the-art (SOTA) accuracy on popular datasets in readability assessment. The use of handcrafted features help model performance on smaller datasets. Notably, our RoBERTA-RF-T1 hybrid achieves the near-perfect classification accuracy of 99%, a 20.3% increase from the previous SOTA.
EMNLP 2021
References in corpus (9)
- Scikit-learn: Machine Learning in Python
- Efficient Estimation of Word Representations in Vector Space
- Natural Language Processing (almost) from Scratch
- SAGA: A Fast Incremental Gradient Method With Support for Non-Strongly Convex Composite Objectives
- Text Readability Assessment for Second Language Learners
- Supervised and Unsupervised Neural Approaches to Text Readability
- Linguistic Features for Readability Assessment
- Readability-based Sentence Ranking for Evaluating Text Simplification
- LXPER Index: a curriculum-specific text readability assessment model for EFL students in Korea