7 citations · 9 across the 9 of their papers we have counts for
11 papers · 1 filter
RE-IMAGINE: Symbolic Benchmark Synthesis for Reasoning Evaluation
Xinnuo Xu, Rachel Lawrence, Kshitij Dubey +7
Recent Large Language Models (LLMs) have reported high accuracy on reasoning benchmarks. However, it is still unclear whether the observed results arise from true reasoning or from…
Synthetic Function Demonstrations Improve Generation in Low-Resource Programming Languages
Nick McKenna, Xinnuo Xu, Jack Williams +3
A key consideration when training an LLM is whether the target language is more or less resourced, for example English compared to Welsh, or Python compared to Excel. Typical train…
Compositional Causal Reasoning Evaluation in Language Models
Jacqueline R. M. A. Maasch, Alihan Hüyük, Xinnuo Xu +2
Causal reasoning and compositional reasoning are two core aspirations in AI. Measuring the extent of these behaviors requires principled evaluation methods. We explore a unified pe…
Reasoning Elicitation in Language Models via Counterfactual Feedback
Alihan Hüyük, Xinnuo Xu, Jacqueline Maasch +2
Despite the increasing effectiveness of language models, their reasoning capabilities remain underdeveloped. In particular, causal reasoning through counterfactual question answeri…
Graph Guided Question Answer Generation for Procedural Question-Answering
Hai X. Pham, Isma Hadji, Xinnuo Xu +6
In this paper, we focus on task-specific question answering (QA). To this end, we introduce a method for generating exhaustive and high-quality training data, which allows us to tr…
Compositional Generalization for Data-to-Text Generation
Xinnuo Xu, Ivan Titov, Mirella Lapata
Data-to-text generation involves transforming structured data, often represented as predicate-argument tuples, into coherent textual descriptions. Despite recent advances, systems…