Assessing AI Utility: The Random Guesser Test for Sequential Decision-Making Systems

Shun Ide, Allison Blunt, Djallel Bouneffouf

We propose a general approach to quantitatively assessing the risk and vulnerability of artificial intelligence (AI) systems to biased decisions. The guiding principle of the propo…