2 papers
cs.AI2024
Can We Count on LLMs? The Fixed-Effect Fallacy and Claims of GPT-4 Capabilities
Thomas Ball, Shuo Chen, Cormac Herley
In this paper we explore evaluation of LLM capabilities. We present measurements of GPT-4 performance on several deterministic tasks; each task involves a basic calculation and tak…
cs.CR2024
Theorem-Carrying Transactions: Runtime Verification to Ensure Interface Specifications for Smart Contract Safety
Thomas Ball, Nikolaj S. Bjørner, Ashley J. Chen +6
Security bugs and trapdoors in smart contracts have been impacting the Ethereum community since its inception. Conceptually, the 1.45-million Ethereum's contracts form a single "gi…