Understanding Agent Incentives using Causal Influence Diagrams. Part I: Single Action Settings

Tom Everitt, Pedro A. Ortega, Elizabeth Barnes +1

Agents are systems that optimize an objective function in an environment. Together, the goal and the environment induce secondary objectives, incentives. Modeling the agent-environ…