4 papers
JE-IRT: A Geometric Lens on LLM Abilities through Joint Embedding Item Response Theory
Louie Hong Yao, Nicholas Jarvis, Tiffany Zhan +3
Standard LLM evaluation practices compress diverse abilities into single scores, obscuring their inherently multidimensional nature. We present JE-IRT, a geometric item-response fr…
Cross-Lingual Steering for Figurative Language Generation
Linfeng Liu, Tiffany Zhan, Louie Hong Yao +2
Multilingual large language models can generate figurative language, but whether the internal signals driving this behavior are language-specific or reusable across languages is un…
Evaluating the Impact of Verbal Multiword Expressions on Machine Translation
Linfeng Liu, Saptarshi Ghosh, Tianyu Jiang
Verbal multiword expressions (VMWEs) remain difficult for machine translation because their meanings are often not recoverable from their component words. In this study, we analyze…
A Computational Approach to Visual Metonymy
Saptarshi Ghosh, Linfeng Liu, Tianyu Jiang
Images often communicate more than they literally depict: a set of tools can suggest an occupation and a cultural artifact can suggest a tradition. This kind of indirect visual ref…