Showing cs.AIShow all
2 papers · 1 filter
cs.AI2026
Right Order, Wrong Scale: Auditing LLM Judges for Occupational AI Measurement
Harry Lyu, Neil Thompson
LLM judges are increasingly used to assess whether AI outputs meet workplace requirements, but agreement on response rankings does not establish agreement on acceptance rates or oc…
cs.AI2026
Crashing Waves vs. Rising Tides: Findings on AI Automation from Thousands of Worker Evaluations of Labor Market Tasks
Matthias Mertens, Adam Kuzee, Brittany S. Harris +6
We characterize AI automation as a continuum between crashing waves, in which capabilities jump abruptly across narrow task sets, and rising tides, in which capabilities improve co…