Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects

Reva Schwartz, Rumman Chowdhury, Akash Kundu +17

Conventional AI evaluation approaches concentrated within the AI stack exhibit systemic limitations for exploring, navigating and resolving the human and societal factors that play…