5 citations · 5 across the 10 of their papers we have counts for
5 papers · 1 filter
LLJ Cards: Best practices for the Use of LLMs as Judges
Khaoula Chehbouni, Melina Medjdoub, Florian Carichon +2
In recent years, large language models (LLMs) have emerged as a popular alternative for evaluation. Often referred to as LLMs as judges (LLJs), these systems have been widely adopt…
Even More Deception: Objective Misalignment in Mixed-Motive LLM Multi-Agent Systems
Marylou Fauchard, Florian Carichon, Margarida Carvalho +1
Large Language Models (LLMs)-powered multi-agent systems are increasingly deployed in mixed-motive environments, where agents operate under asymmetric information and strategic dec…
IDEAFix: Evaluation Framework for Creative Defixation Prompting in LLMs
F. Carichon, S. Sharma, M. Girard +2
Large language models (LLMs) are increasingly used for tasks involving creative problem solving and idea generation. However, there is a lack of consensus concerning their creative…
Mechanics of Bias and Reasoning: Interpreting the Impact of Chain-of-Thought Prompting on Gender Bias in LLMs
Edie Pearman, Sophia Osborne, Mira Kandlikar-Bloch +3
Large language models (LLMs) are increasingly deployed in socially sensitive settings despite substantial documentation that they encode gender biases. Chain-of-Thought (CoT) promp…
Can LLMs Cook Jamaican Couscous? A Study of Cultural Novelty in Recipe Generation
F. Carichon, R. Rampa, G. Farnadi
Large Language Models (LLMs) are increasingly used to generate and shape cultural content, ranging from narrative writing to artistic production. While these models demonstrate imp…