1 citations · 2 across the 9 of their papers we have counts for
3 papers · 1 filter
Reasoning Models are Test Exploiters: Rethinking Multiple-Choice
Narun Raman, Taylor Lundy, Kevin Leyton-Brown
When evaluating Large Language Models (LLMs) in question answering domains, it is common to ask the model to choose among a fixed set of choices (so-called multiple-choice question…
NFTs as a Data-Rich Test Bed: Conspicuous Consumption and its Determinants
Taylor Lundy, Narun Raman, Scott Duke Kominers +1
Conspicuous consumption occurs when a consumer derives value from a good based on its social meaning as a signal of wealth, taste, and/or community affiliation. Common conspicuous…
STEER-ME: Assessing the Microeconomic Reasoning of Large Language Models
Narun Raman, Taylor Lundy, Thiago Amin +2
How should one judge whether a given large language model (LLM) can reliably perform economic reasoning? Most existing LLM benchmarks focus on specific applications and fail to pre…