10 citations · 10 across the 13 of their papers we have counts for
4 papers · 1 filter
Agents Are Systems, Not Models: Rethinking Agentic Evaluation
Luis Wiedmann, Leander Girrbach, Cordelia Schmid +1
Agent evaluations increasingly go beyond a single success rate, reporting metrics such as cost, consistency, and robustness. Yet they typically treat the agent itself as fixed. In…
APM: Evaluating Style Personalization in LLMs with Arbitrary Preference Mappings
Philipp Spohn, Leander Girrbach, Zeynep Akata
Typical LLM responses tend to follow a default style, even though users often have distinct preferences regarding tone, verbosity, and formality that they do not explicitly state i…
Do LLMs Experience an Internal Polylogue? Investigating Reasoning through the Lens of Personas
Nils A. Herrmann, Leander Girrbach, Kirill Bykov +1
Recent work shows that large language models (LLMs) encode behavioral traits ("personas") as linear directions in activation space, often called "persona vectors". Prior work has u…
Are Reasoning LLMs Robust to Interventions on Their Chain-of-Thought?
Alexander von Recum, Leander Girrbach, Zeynep Akata
Reasoning LLMs (RLLMs) generate step-by-step chains of thought (CoTs) before giving an answer, which improves performance on complex tasks and makes reasoning more transparent. But…