activity
20182023
most citedBeyond the Imitation Game: Quantifying and extrapolating the capabilities of language models

565 citations · 881 across the 17 of their papers we have counts for

collaborators
Showing 2023Show all

7 papers · 1 filter

cs.AI2023★ 1 cited

Choice-75: A Dataset on Decision Branching in Script Learning

Zhaoyi Joey Hou, Li Zhang, Chris Callison-Burch

Script learning studies how stereotypical events unfold, enabling machines to reason about narratives with implicit information. Previous works mostly consider a script as a linear…

cs.CL2023

OpenPI2.0: An Improved Dataset for Entity Tracking in Texts

Li Zhang, Hainiu Xu, Abhinav Kommula +2

Much text describes a changing world (e.g., procedures, stories, newswires), and understanding them requires tracking how entities change. An earlier dataset, OpenPI, provided crow…

cs.CL2023

Exploring the Curious Case of Code Prompts

Li Zhang, Liam Dugan, Hainiu Xu +1

Recent work has shown that prompting language models with code-like representations of natural language leads to performance improvements on structured reasoning tasks. However, su…

cs.HC2023★ 8 cited

Human-in-the-Loop Schema Induction

Tianyi Zhang, Isaac Tham, Zhaoyi Hou +12

Schema induction builds a graph representation explaining how events unfold in a scenario. Existing approaches have been based on information retrieval (IR) and information extract…

cs.CL2023

Causal Reasoning of Entities and Events in Procedural Texts

Li Zhang, Hainiu Xu, Yue Yang +4

Entities and events are crucial to natural language reasoning and common in procedural texts. Existing work has focused either exclusively on entity state tracking (e.g., whether a…

cs.SD2023

Language Models are Drummers: Drum Composition with Natural Language Pre-Training

Li Zhang, Chris Callison-Burch

Automatic music generation with artificial intelligence typically requires a large amount of data which is hard to obtain for many less common genres and musical instruments. To ta…

cs.CL2023★ 23 cited

Faithful Chain-of-Thought Reasoning

Qing Lyu, Shreya Havaldar, Adam Stein +5

While Chain-of-Thought (CoT) prompting boosts Language Models' (LM) performance on a gamut of complex reasoning tasks, the generated reasoning chain does not necessarily reflect ho…