3 papers
cs.LG2025
Open Polymer Challenge: Post-Competition Report
Gang Liu, Sobin Alosious, Subhamoy Mahajan +9
Machine learning (ML) offers a powerful path toward discovering sustainable polymer materials, but progress has been limited by the lack of large, high-quality, and openly accessib…
cs.LG2025
Exploring Human-AI Conceptual Alignment through the Prism of Chess
Semyon Lomasov, Judah Goldfeder, Mehmet Hamza Erol +5
Do AI systems truly understand human concepts or merely mimic surface patterns? We investigate this through chess, where human creativity meets precise strategic concepts. Analyzin…
cs.AI2025
Position: AI Competitions Provide the Gold Standard for Empirical Rigor in GenAI Evaluation
D. Sculley, Will Cukierski, Phil Culliton +8
In this position paper, we observe that empirical evaluation in Generative AI is at a crisis point since traditional ML evaluation and benchmarking strategies are insufficient to m…