Measurement in AI Policy: Opportunities and Challenges
arXiv:2009.09071
Abstract
As artificial intelligence increasingly influences our world, it becomes crucial to assess its technical progress and societal impact. This paper surveys problems and opportunities in the measurement of AI systems and their impact, based on a workshop held at Stanford University in the fall of 2019. We identify six summary challenges inherent to measuring the progress and impact of AI, and summarize over 40 presentations and associated discussions from the workshop. We hope this can inspire research agendas in this crucial area.
arXiv commentWorkshop Paper
References in corpus (8)
- YouTube-8M: A Large-Scale Video Classification Benchmark
- A Short Note on the Kinetics-700-2020 Human Action Dataset
- A Short Note about Kinetics-600
- The AVA-Kinetics Localized Human Actions Video Dataset
- Recent Advances in Natural Language Inference: A Survey of Benchmarks, Resources, and Approaches
- The ActivityNet Large-Scale Activity Recognition Challenge 2018 Summary
- ActivityNet Challenge 2017 Summary
- Deep learning, deep change? Mapping the development of the Artificial Intelligence General Purpose Technology