15 citations · 30 across the 23 of their papers we have counts for
4 papers · 1 filter
Time Capsule of Testable Human Knowledge: 41 Years of Jeopardy! in a Single Free Local Model
David Noever, Forrest McKee
In 2011, IBM's Watson was something like a sealed capsule of its era's queryable knowledge. Its DeepQA system defeated the strongest human Jeopardy! champions, but the knowledge th…
Moravec's Paradox: Towards an Auditory Turing Test
David Noever, Forrest McKee
This research work demonstrates that current AI systems fail catastrophically on auditory tasks that humans perform effortlessly. Drawing inspiration from Moravec's paradox (i.e.,…
Can AI Freelancers Compete? Benchmarking Earnings, Reliability, and Task Success at Scale
David Noever, Forrest McKee
This study explores Large Language Models (LLMs) as autonomous agents for real-world tasks, including freelance software development. This work presents a new benchmark that evalua…
Chatbots as Problem Solvers: Playing Twenty Questions with Role Reversals
David Noever, Forrest McKee
New chat AI applications like ChatGPT offer an advanced understanding of question context and memory across multi-step tasks, such that experiments can test its deductive reasoning…