6 papers · 1 filter
CORDA: A Benchmark for Hierarchical Harm-Centric Moral Reasoning in Large Language Models
Siddarth Singh, Victoria Williams, Simon Rosen +6
The key question in moral judgement is not simply whether someone chooses the "right" answer, but how they decide what matters most when moral principles conflict. Current evaluati…
Characterizing MARL for Energy Control: A Multi-KPI Benchmark on the CityLearn Environment
Aymen Khouja, Imen Jendoubi, Oumayma Mahjoub +4
The optimization of urban energy systems is crucial for the advancement of sustainable and resilient smart cities, which are becoming increasingly complex with multiple decision-ma…
MoralityGym: A Benchmark for Evaluating Hierarchical Moral Alignment in Sequential Decision-Making Agents
Simon Rosen, Siddarth Singh, Ebenezer Gelo +6
Evaluating moral alignment in agents navigating conflicting, hierarchically structured human norms is a critical challenge at the intersection of AI safety, moral philosophy, and c…
Efficiently Quantifying Individual Agent Importance in Cooperative MARL
Omayma Mahjoub, Ruan de Kock, Siddarth Singh +4
Measuring the contribution of individual agents is challenging in cooperative multi-agent reinforcement learning (MARL). In cooperative MARL, team performance is typically inferred…
How much can change in a year? Revisiting Evaluation in Multi-Agent Reinforcement Learning
Siddarth Singh, Omayma Mahjoub, Ruan de Kock +4
Establishing sound experimental standards and rigour is important in any growing field of research. Deep Multi-Agent Reinforcement Learning (MARL) is one such nascent field. Althou…
On Diagnostics for Understanding Agent Training Behaviour in Cooperative MARL
Wiem Khlifi, Siddarth Singh, Omayma Mahjoub +4
Cooperative multi-agent reinforcement learning (MARL) has made substantial strides in addressing the distributed decision-making challenges. However, as multi-agent systems grow in…