16 papers
Conformalized Large Language Models under Configuration Shift
Yuqicheng Zhu, Jialin Yu, Lin Li +7
Conformal prediction (CP) is a distribution-free framework for uncertainty quantification that has recently been adapted to large language models (LLMs), providing prediction sets…
OpenFinGym: A Verifiable Multi-Task Gym Environment for Evaluating Quant Agents
Kaicheng Zhang, Wen Ge, Lei Jiang +5
Although large language model agents are increasingly applied to quantitative-finance workflows, their evaluation remains fragmented across isolated tasks, while the financial rele…
A Low-Rank Subspace Analysis of LLM Interventions
Angira Sharma, Christian Schroeder de Witt, Philip Torr +2
Interventions designed to modify a particular behavior in LLMs, such as refusal or sycophancy, often produce unintended changes in other behaviors. This lack of targeted control ma…
When Language Representations Interact: Separability and Cross-Lingual Effects in LLMs
Boris Marinov, Angira Sharma, Christian Schroeder de Witt +3
Large language models exhibit strong multilingual capabilities, however, their internal representations are difficult to interpret. Understanding these interactions is important fo…
Benchmarking at the Edge of Comprehension
Samuele Marro, Jialin Yu, Emanuele La Malfa +8
As frontier Large Language Models (LLMs) increasingly saturate new benchmarks shortly after they are published, benchmarking itself is at a juncture: if frontier models keep improv…
Retrieval-Augmented Linguistic Calibration
Yi-Fan Yeh, Linwei Tao, Minjing Dong +4
Linguistic cues such as "I believe" and "probably" offer an intuitive interface for communicating confidence, yet a generalisable, principled calibration framework for linguistic c…