90 citations · 228 across the 19 of their papers we have counts for
10 papers · 1 filter
Testing GPT-4 with Wolfram Alpha and Code Interpreter plug-ins on math and science problems
Ernest Davis, Scott Aaronson
This report describes a test of the large language model GPT-4 with the Wolfram Alpha and the Code Interpreter plug-ins on 105 original problems in science and math, at the high sc…
Benchmarks for Automated Commonsense Reasoning: A Survey
Ernest Davis
More than one hundred benchmarks have been developed to test the commonsense knowledge and commonsense reasoning abilities of artificial intelligence (AI) systems. However, these b…
Mathematics, word problems, common sense, and artificial intelligence
Ernest Davis
The paper discusses the capacities and limitations of current artificial intelligence (AI) technology to solve word problems that combine elementary knowledge with commonsense reas…
Limits of an AI program for solving college math problems
Ernest Davis
Drori et al. (2022) report that "A neural network solves, explains, and generates university math problems by program synthesis and few-shot learning at human level ... [It] automa…
Physical Reasoning in an Open World
Zhuoran Zeng, Ernest Davis
Most work on physical reasoning, both in artificial intelligence and in cognitive science, has focused on closed-world reasoning, in which it is assumed that the problem specificat…
Winograd Schemas and Machine Translation
Ernest Davis
A Winograd schema is a pair of sentences that differ in a single word and that contain an ambiguous pronoun whose referent is different in the two sentences and requires the use of…
The Scope and Limits of Simulation in Cognitive Models
Ernest Davis, Gary Marcus
It has been proposed that human physical reasoning consists largely of running "physics engines in the head" in which the future trajectory of the physical system under considerati…
The Limitations of Standardized Science Tests as Benchmarks for Artificial Intelligence Research: Position Paper
Ernest Davis
In this position paper, I argue that standardized tests for elementary science such as SAT or Regents tests are not very good benchmarks for measuring the progress of artificial in…
The Relevance of Proofs of the Rationality of Probability Theory to Automated Reasoning and Cognitive Models
Ernest Davis
A number of well-known theorems, such as Cox's theorem and de Finetti's theorem. prove that any model of reasoning with uncertain information that satisfies specified conditions of…
Order of Magnitude Comparisons of Distance
E. Davis
Order of magnitude reasoning - reasoning by rough comparisons of the sizes of quantities - is often called 'back of the envelope calculation', with the implication that the calcula…