activity
20222026
most citedBeyond the Imitation Game: Quantifying and extrapolating the capabilities of language models

565 citations · 569 across the 5 of their papers we have counts for

collaborators

6 papers

cs.CL2026

The Geometry of Metaphor: Probing and Steering Metaphor Representations in Large Language Models

Shihui Li, Mette Andersen, Martha Lewis

Metaphor is a crucial aspect of human cognition. As such, we would like to understand how it is represented in large language models (LLMs) and how it might be controlled. We use m…

cs.CL2025

Hummus: A Dataset of Humorous Multimodal Metaphor Use

Xiaoyu Tong, Zhi Zhang, Pia Sommerauer +2

Metaphor and humor share a lot of common ground, and metaphor is one of the most common humorous mechanisms. This study focuses on the humorous capacity of multimodal metaphors, wh…

cs.CL2024

Density Matrices for Metaphor Understanding

Jasmine Owers, Ekaterina Shutova, Martha Lewis

In physics, density matrices are used to represent mixed states, i.e. probabilistic mixtures of pure states. This concept has previously been used to model lexical ambiguity. In th…

cs.CL2024★ 3 cited

Rel-A.I.: An Interaction-Centered Approach To Measuring Human-LM Reliance

Kaitlyn Zhou, Jena D. Hwang, Xiang Ren +3

The ability to communicate uncertainty, risk, and limitation is crucial for the safety of large language models. However, current evaluations of these abilities rely on simple cali…

cs.CL2024★ 1 cited

Metaphor Understanding Challenge Dataset for LLMs

Xiaoyu Tong, Rochelle Choenni, Martha Lewis +1

Metaphors in natural language are a reflection of fundamental cognitive processes such as analogical reasoning and categorisation, and are deeply rooted in everyday communication.…

cs.CL2022★ 565 cited

Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models

Aarohi Srivastava, Abhinav Rastogi, Abhishek Rao +448

Language models demonstrate both quantitative improvement and new qualitative capabilities with increasing scale. Despite their potentially transformative impact, these new capabil…