24 citations · 25 across the 4 of their papers we have counts for
4 papers
Position: AI Competitions Provide the Gold Standard for Empirical Rigor in GenAI Evaluation
D. Sculley, Will Cukierski, Phil Culliton +8
In this position paper, we observe that empirical evaluation in Generative AI is at a crisis point since traditional ML evaluation and benchmarking strategies are insufficient to m…
Challenge design roadmap
Hugo Jair Escalante Balderas, Isabelle Guyon, Addison Howard +2
Challenges can be seen as a type of game that motivates participants to solve serious tasks. As a result, competition organizers must develop effective game rules. However, these r…
Deep learning models for predicting RNA degradation via dual crowdsourcing
Hannah K. Wayment-Steele, Wipapat Kladwang, Andrew M. Watkins +26
Messenger RNA-based medicines hold immense potential, as evidenced by their rapid deployment as COVID-19 vaccines. However, worldwide distribution of mRNA molecules has been limite…
A community-powered search of machine learning strategy space to find NMR property prediction models
Lars A. Bratholm, Will Gerrard, Brandon Anderson +26
The rise of machine learning (ML) has created an explosion in the potential strategies for using data to make scientific predictions. For physical scientists wishing to apply ML st…