1 citations · 1 across the 3 of their papers we have counts for
6 papers
Beyond Context Length: Characterising the Difficulty of Long-Context Reasoning
Shiwen Qin, Cameron Barker, Henry Gouk +4
Long-context language models support ever longer context windows, and evaluations typically treat context length as the main indicator of difficulty. However, context length alone…
Match the Canvas, Not Just the Answer: Predictability-Aware SFT for Diffusion Language Models
Miao Li, Hanyang Jiang, Hengyu Fu +8
Diffusion language models (DLMs) enable flexible parallel generation by resolving tokens according to the model's evolving predictability rather than a fixed left-to-right order. T…
Plan, Verify and Fill: A Structured Parallel Decoding Approach for Diffusion Language Models
Miao Li, Hanyang Jiang, Sikai Cheng +6
Diffusion Language Models (DLMs) present a promising non-sequential paradigm for text generation, distinct from standard autoregressive (AR) approaches. However, current decoding s…
SciTrek: Evaluating and Improving Long-Context Numerical Reasoning over Scientific Articles
Miao Li, Alexander Gurung, Irina Saparina +1
We introduce SciTrek, a synthetic question-answering dataset for assessing and improving long-context numerical reasoning in large language models (LLMs). Existing long-context dat…
Understanding and Mitigating Bias Inheritance in LLM-based Data Augmentation on Downstream Tasks
Miaomiao Li, Hao Chen, Yang Wang +5
Generating synthetic datasets via large language models (LLMs) has emerged as a promising approach to improve LLM performance. However, LLMs inherently reflect biases in their trai…
DeltaScore: Fine-Grained Story Evaluation with Perturbations
Zhuohan Xie, Miao Li, Trevor Cohn +1
Numerous evaluation metrics have been developed for natural language generation tasks, but their effectiveness in evaluating stories is limited as they are not specifically tailore…