5 citations · 5 across the 4 of their papers we have counts for
3 papers · 1 filter
RoleFUZZER: User-Behaviour Fuzzing for Role-Specification Adherence in Large Language Models
Kshitish Ghate, Michael Saxon, Tadayoshi Kohno +1
Large language models (LLMs) are often conditioned into specific roles such as tutors, interviewers, or agents acting for an organisation, through system prompts that specify how t…
RPAM: A Principled Metric for Evaluating Associations in Language Models with High Predictive Validity in Downstream Outputs
Damian Hodel, Jevin West, Aylin Caliskan
Language models (LMs) exhibit problematic biases, such as stereotypes. Effectively analyzing and mitigating such biases requires accurate and generalizable evaluation methods of th…
Deep Reasoning in General Purpose Agents via Structured Meta-Cognition
Dean Light, Michael Theologitis, Kshitish Ghate +7
Humans intuitively solve complex problems by flexibly shifting among reasoning modes: they plan, execute, revise intermediate goals, resolve ambiguity through associative judgment,…