Text Readability Assessment for Second Language Learners

Abstract

This paper addresses the task of readability assessment for the texts aimed at second language (L2) learners. One of the major challenges in this task is the lack of significantly sized level-annotated data. For the present work, we collected a dataset of CEFR-graded texts tailored for learners of English as an L2 and investigated text readability assessment for both native and L2 learners. We applied a generalization method to adapt models trained on larger native corpora to estimate text readability for learners, and explored domain adaptation and self-learning techniques to make use of the native data to improve system performance on the limited L2 data. In our experiments, the best performing model for readability on learner texts achieves an accuracy of 0.797 and PCC of $0.938$.

Proceedings of the 11th Workshop on Innovative Use of NLP for Building Educational Applications

References in corpus (2)

• Frustratingly Easy Domain Adaptation
• A Readable Read: Automatic Assessment of Language Learning Materials based on Linguistic Complexity

Cited by in corpus (18)

• Supervised and Unsupervised Neural Approaches to Text Readability
• Linguistic Features for Readability Assessment
• Candidate sentence selection for language learning exercises: from a comprehensive framework to an empirical evaluation
• ReadNet: A Hierarchical Transformer Framework for Web Article Readability Analysis
• Learning to Paraphrase Sentences to Different Complexity Levels
• Text as Environment: A Deep Reinforcement Learning Text Readability Assessment Model
• LXPER Index: a curriculum-specific text readability assessment model for EFL students in Korea
• Grammatical Templates: Improving Text Difficulty Evaluation for Language Learners
• A Simple Post-Processing Technique for Improving Readability Assessment of Texts using Word Mover's Distance
• Under the Microscope: Interpreting Readability Assessment Models for Filipino
• Automatic learner summary assessment for reading comprehension
• EXPATS: A Toolkit for Explainable Automated Text Scoring
• LXPER Index 2.0: Improving Text Readability Assessment Model for L2 English Students in Korea
• Applying Text Mining to Analyze Human Question Asking in Creativity Research
• Pushing on Text Readability Assessment: A Transformer Meets Handcrafted Linguistic Features
• Learning Syntactic Dense Embedding with Correlation Graph for Automatic Readability Assessment
• GrammarTagger: A Multilingual, Minimally-Supervised Grammar Profiler for Language Education
• BERT Embeddings for Automatic Readability Assessment