Beyond Benchmarks: On The False Promise of AI Regulation

Gabriel Stanovsky, Renana Keydar, Gadi Perl +1

The performance of AI models on safety benchmarks does not indicate their real-world performance after deployment. This opaqueness of AI models impedes existing regulatory framewor…