1 citations · 1 across the 6 of their papers we have counts for
7 papers
FreqBLiMP: Frequency-Controlled Minimal Pairs Reveal Robustness and Fragility of LLMs Under Lexical Rarity
Tyrone White, Yuki Arase
Minimal-pair benchmarks such as BLiMP evaluate linguistic knowledge by testing whether language models (LMs) prefer acceptable sentences over minimally different unacceptable ones.…
Reasoning Model Is Superior LLM-Judge, Yet Suffers from Biases
Hui Huang, Xuanxin Wu, Muyun Yang +1
This paper presents the first systematic comparison investigating whether Large Reasoning Models (LRMs) are superior judges to non-reasoning LLMs. Our empirical analysis yields fou…
AEScorer: An Agentic Evidence-Grounded Framework for Graded Factuality Verification
Hui Huang, Muyun Yang, Yuki Arase
Despite the significant advancements of Large Language Models (LLMs), their factuality remains a critical challenge, creating a growing need for more nuanced factuality verificatio…
Edit Policy-Aligned Text Simplification
Xuanxin Wu, Yuki Arase, Masaaki Nagata
Text simplification aims to modify documents and sentences to make them easier to read and understand while preserving their meanings. Different applications require distinct simpl…
Camellia: Benchmarking Cultural Biases in LLMs for Asian Languages
Tarek Naous, Anagha Savit, Carlos Rafael Catalan +17
As Large Language Models (LLMs) develop stronger multilingual capabilities, their sensitivity to culturally diverse entities becomes increasingly important. Prior work by Naous et…
Aligning Sentence Simplification with ESL Learner's Proficiency for Language Acquisition
Guanlin Li, Yuki Arase, Noel Crespi
Text simplification is crucial for improving accessibility and comprehension for English as a Second Language (ESL) learners. This study goes a step further and aims to facilitate…
An In-depth Evaluation of Large Language Models in Sentence Simplification with Error-based Human Assessment
Xuanxin Wu, Yuki Arase
Recent studies have used both automatic metrics and human evaluations to assess the simplification abilities of LLMs. However, the suitability of existing evaluation methodologies…